-- Logs begin at Tue 2022-07-12 15:35:46 UTC, end at Tue 2022-07-12 16:39:27 UTC. -- Jul 12 16:12:50.267752 dv-cinder-797608-56-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 16:12:50.276373 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 16:12:50 2022] *** Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: nodename: dv-cinder-797608-56-iscsi Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: machine: x86_64 Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: clock source: unix Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: pcre jit disabled Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: detected number of CPU cores: 4 Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: current working directory: / Jul 12 16:12:50.278364 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: detected binary path: /usr/bin/uwsgi-core Jul 12 16:12:50.279081 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: your processes number limit is 47680 Jul 12 16:12:50.279081 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: your memory page size is 4096 bytes Jul 12 16:12:50.279081 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: detected max file descriptor number: 2048 Jul 12 16:12:50.279081 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: lock engine: pthread robust mutexes Jul 12 16:12:50.279081 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: thunder lock: enabled Jul 12 16:12:50.279081 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 16:12:50.279081 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 16:12:50.321550 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: Python main interpreter initialized at 0x55fdca68d9c0 Jul 12 16:12:50.321550 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: python threads support enabled Jul 12 16:12:50.321742 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: your server socket listen backlog is limited to 100 connections Jul 12 16:12:50.321742 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: your mercy for graceful operations on workers is 90 seconds Jul 12 16:12:50.321880 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 16:12:50.321954 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: *** Operational MODE: preforking *** Jul 12 16:12:50.322225 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: *** uWSGI is running in multiple interpreter mode *** Jul 12 16:12:50.322225 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: spawned uWSGI master process (pid: 103263) Jul 12 16:12:50.322420 dv-cinder-797608-56-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 16:12:50.322983 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: spawned uWSGI worker 1 (pid: 103264, cores: 1) Jul 12 16:12:50.323313 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: spawned uWSGI worker 2 (pid: 103265, cores: 1) Jul 12 16:12:50.324088 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 16:12:50.977361 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 16:12:50.978691 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 16:12:52.096462 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:12:52.096462 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: from cryptography.utils import int_from_bytes Jul 12 16:12:52.097088 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:12:52.097088 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: from cryptography.utils import int_from_bytes Jul 12 16:12:52.097486 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:12:52.097486 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes Jul 12 16:12:52.097924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:12:52.097924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes Jul 12 16:12:54.564374 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 16:12:54.565041 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 16:12:54.565171 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 16:12:54.565508 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 16:12:54.565765 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 16:12:54.566074 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 16:12:54.566458 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.566548 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 16:12:54.566623 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.566764 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.566866 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 16:12:54.567080 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.567181 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 16:12:54.567409 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.567498 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 16:12:54.567718 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.567811 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.568034 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.568132 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.568353 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.568439 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.568677 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.568781 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.568938 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.569037 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.569276 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.569370 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.569598 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-56-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.569696 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.569916 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.570004 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.570220 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.570308 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.570529 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.570627 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.570852 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.570994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.571149 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.571262 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-56-iscsi {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.571467 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.571563 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.571815 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.571910 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.572080 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.572272 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.572398 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.572698 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.572823 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.573016 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.573153 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.573865 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.574176 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.574298 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.574398 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.574488 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.574682 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.574783 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.574995 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.575083 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.575310 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.575404 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.575649 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.575794 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.575968 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.576055 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.576280 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.576421 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-56-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.576619 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.576796 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.576914 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.577001 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.577273 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.577373 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.577586 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.577672 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.577969 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.578055 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-56-iscsi {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.578277 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.578362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.578587 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.578685 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.578903 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.578990 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.579204 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.579317 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.579530 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.579625 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.579847 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.579945 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.580163 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.580251 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.580480 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.580581 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.580779 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.580867 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.581103 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.581251 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.581411 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.581498 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.581728 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.581814 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.582032 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.582132 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.582335 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.582422 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.582592 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.582678 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.582899 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.583017 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.583214 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.583302 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.583531 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.583625 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.583853 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584009 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584092 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584170 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584339 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584427 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584655 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584743 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.584971 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.585086 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.585305 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.585402 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.585579 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.585664 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.585835 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.585922 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.586154 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.586251 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.586476 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.586566 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.586780 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.586877 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.587084 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.587172 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.587388 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.587484 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.587694 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.587836 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.588006 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.588089 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.588300 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.588386 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.588599 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.588685 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.588906 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.589027 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.589829 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.589924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.590153 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.590240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.590461 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.590550 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.590773 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.590857 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.591097 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.591201 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.591401 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.591487 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.591720 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.591817 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.592032 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.592129 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.592333 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.592644 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.592731 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.592955 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.593114 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.593301 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.593408 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.593618 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.593703 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.593918 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.594030 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.594174 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.594269 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.594472 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.594557 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.594774 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.594862 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.595091 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.595176 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.595395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.595479 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.595667 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.595768 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.595971 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.596063 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.596268 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.596352 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.596571 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.596657 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.596877 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.597026 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.597200 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.597303 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.597502 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.597592 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.597801 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.597896 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.598098 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.598183 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.598400 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.598493 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.598697 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.598789 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.598998 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.599094 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.599299 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.599384 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.599605 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.599692 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.599906 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.600001 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.600208 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.600304 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.600508 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.600603 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.600809 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.600912 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.601148 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.601239 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.601459 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.601565 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.601760 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.601854 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.602067 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.602155 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.602366 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.602451 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.602673 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.602774 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.602975 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.603063 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.603279 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.603379 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.603580 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.603673 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.603882 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.603965 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.604179 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.604270 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.604482 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.604576 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.604811 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.604895 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.605133 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.605222 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.605438 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.605533 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.605737 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.605822 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.606038 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.606124 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.606339 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.606425 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.606637 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.606728 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.606940 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.607114 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.607223 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.607395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.607540 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.607674 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.607809 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.607941 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.608088 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.608224 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.608390 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.608549 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.608681 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.608824 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.608977 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.609138 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.609303 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.609449 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.609626 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.609772 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.609937 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.610084 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.610244 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.610381 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.610551 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.610692 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.610870 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:12:54.611018 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.611203 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.611353 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.611521 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.611619 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.611831 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.611919 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.612145 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.612233 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.612475 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.612575 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.612785 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.612874 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.613121 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.613238 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.613433 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.613528 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.613745 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.613846 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.614061 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.614164 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.614368 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.614461 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.614682 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.614777 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.614994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.615101 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.615308 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.615408 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.615614 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.615708 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.615930 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.616024 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.616248 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.616346 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.616565 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.616666 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.616876 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.616971 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.617206 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.617306 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.617526 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.617622 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.617858 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.617954 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.618181 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.618283 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.618489 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.618582 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.618797 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.618899 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.619106 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.619202 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.619417 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.619513 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.619738 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.619842 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.620070 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.620163 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.620402 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.620496 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.620710 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.620857 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.621006 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.621507 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.621644 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.621728 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.621892 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.621994 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.622202 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.622294 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.622517 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.622614 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.622827 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.622913 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.623141 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.623226 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.623452 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.623543 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.623760 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.623844 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.624070 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.624166 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.624380 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.624472 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.624687 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.624773 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.624994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.625110 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.625327 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.625411 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.625626 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.625711 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.625928 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.626013 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.626240 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.626407 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.626550 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.626686 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.626823 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.626960 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.627114 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.627261 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.627405 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.627541 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.627712 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.627851 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.628017 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.628160 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.628326 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.628463 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.628634 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.628773 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.628940 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.629127 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.629264 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.629352 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.629573 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.629668 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.629881 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.629977 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.630183 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.630280 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.630490 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.630584 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.630791 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.630884 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.631093 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.631189 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.631398 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.631485 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.631714 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.631858 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.631997 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.632085 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.632307 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.632394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.632609 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.632696 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.632911 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.632996 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.633248 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.633366 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.633556 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.633668 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.633865 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.633951 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.634172 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.634269 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.634485 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.634632 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.634795 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.634949 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.635110 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.635251 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.635412 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.635548 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.635734 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.636368 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.636581 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.636725 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.636894 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.637023 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.637223 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.637373 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.637535 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.637623 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.637840 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.637925 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.638146 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.638238 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.638453 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.638540 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.638761 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.638847 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.639064 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.639156 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.639367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.639454 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.639668 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.639761 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.639970 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.640057 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.640271 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.640365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.640571 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.640654 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.640878 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.640972 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.641202 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.641288 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.641504 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.641588 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.641802 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.641906 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.642125 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.642210 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.642430 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.642520 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.642732 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.642824 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.643039 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.643131 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.643345 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.643430 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.643687 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.643780 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.643995 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.644080 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.644304 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.644388 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.644612 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.644699 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.644922 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.645007 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.645258 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.645334 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.645568 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.645654 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646051 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646153 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646241 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646319 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646491 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646585 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646795 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.646880 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.647108 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.647192 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.647415 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.647541 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.647725 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.647809 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.648023 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.648107 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.648338 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.648425 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.648660 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.648743 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.648972 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.649131 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.649313 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.649406 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.649614 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.649700 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.649928 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.650026 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.650241 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.650328 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.650550 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.650635 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.650859 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.650953 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.651169 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.651256 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.651532 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.652149 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.652363 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.652459 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.652677 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.652763 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.652990 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.653108 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.653335 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.653435 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.653651 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.653744 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.653960 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.654044 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.654271 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.654356 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.654572 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.654656 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.654887 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.654974 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.655215 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.655302 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.655533 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.655626 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.655842 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.655933 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.656146 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.656231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.656461 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.656547 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.656769 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.656852 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.657113 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.657204 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.657429 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.657516 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.657734 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.657831 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.658041 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.658134 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.658351 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.658443 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.658660 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.658752 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.658966 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.659050 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.659270 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.659353 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.659570 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.659662 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.659880 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.659965 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.660183 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.660274 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.660488 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.660583 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.660790 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.660876 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.661112 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.661199 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.661431 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.661519 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.661736 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.661820 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.662040 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.662124 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.662346 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.662433 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.662651 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.662735 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.662955 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.663040 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.663268 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.663354 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.663573 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.663658 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.663876 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.663962 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.664180 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.664275 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.664481 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.664566 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.664800 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.664903 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.665133 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.665223 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.665434 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.665532 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.665738 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.665830 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.666044 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.666131 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.666347 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.666431 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.666660 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.666754 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.666969 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.667056 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.667303 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.667389 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.667624 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.667754 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.667933 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.668018 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.668237 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.668320 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.668546 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.668641 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.668851 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.668941 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.669177 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.669264 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.669487 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.669575 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.669793 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.669877 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.670103 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.670194 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.670410 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.670502 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.670713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.670796 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.671015 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.671100 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.671323 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.671411 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.671628 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.671726 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.671940 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.672188 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.672275 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.672521 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.672616 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.672834 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.672928 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.673172 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.673261 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.673494 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.673734 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.673820 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.674071 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.674165 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.674391 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.674477 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.674712 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.674798 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.675037 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.675132 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.675352 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.675438 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.675657 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.675749 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.675962 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.676048 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.676272 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.676358 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.676577 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.676677 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.676882 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.676968 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.677210 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.677310 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.677522 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.677616 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.677826 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.677982 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.678130 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.678223 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.678428 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.678513 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.678730 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.678816 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.679036 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.679130 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.679333 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.679417 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.679635 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.679721 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.679935 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.680021 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.680236 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.680320 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.680548 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.680633 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.680849 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.680935 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.681173 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.681263 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.681475 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.681572 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.681797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.681887 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.682106 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.682191 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.682409 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.682540 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.682742 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.682828 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.683050 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.683135 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.683396 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.683489 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.683694 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.683781 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.684018 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.684104 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.684325 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.684423 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.684629 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.684714 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.684931 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.685017 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.685267 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.685371 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.685575 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.685669 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.685879 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.685965 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.686183 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.686274 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.686489 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.686574 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.686797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.686881 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.687101 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.687186 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.687403 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.687487 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.687707 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.687792 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.688015 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.688099 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.688317 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.688401 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.688620 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.688712 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.688921 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.689007 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.689243 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.689337 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.689545 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.689637 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.689848 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.689940 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.690150 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.690237 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.690452 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.690544 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.690750 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.690847 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.691059 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.691152 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.691361 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.691457 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.691664 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.691748 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.691964 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.692049 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.692270 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.692362 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.692573 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.692658 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.692877 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.692963 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.693205 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.693292 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.693515 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.693612 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.693815 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.693900 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.694118 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.694205 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.694420 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.694504 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.694719 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.694803 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.695021 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.695116 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.695329 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.695424 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.695630 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.695714 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.695941 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.696028 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.696236 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.696321 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.696537 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.696629 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.696835 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.696920 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.697161 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.697252 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.697466 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.697570 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.697772 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.697858 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.698074 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.698160 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.698898 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.699076 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.699208 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.699292 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.699490 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.699590 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.699791 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.699886 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.700094 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.700178 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.700402 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.700488 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.700699 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.700784 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.701002 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.701101 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.701324 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.701408 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.701646 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.701732 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.701957 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.702052 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.702263 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.702349 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.702571 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.702665 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.702876 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.702971 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.703197 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.703281 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.703506 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.703593 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.703819 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.703904 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.704131 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.704225 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.704435 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.704522 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.704749 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.704842 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.705097 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.705203 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.705390 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.705482 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.705695 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.705780 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.706001 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.706097 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.706315 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.706407 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.706623 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.706706 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.706928 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.707023 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.707227 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.707311 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.707539 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.707632 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.707856 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.707950 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.708203 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.708309 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.708465 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.708560 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.708771 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.708866 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.709095 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.709195 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.709405 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.709499 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.709710 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.709797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.710018 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.710109 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.710325 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.710410 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.710631 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.710781 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.710937 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.711022 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.711241 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.711326 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.711543 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.711629 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.711850 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.711947 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.712158 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.712253 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.712463 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.712549 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.712769 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.712855 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.713092 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.713193 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.713396 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.713483 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.713705 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.713795 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.714547 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.714649 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.714883 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.714970 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.715196 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.715290 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.715507 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.715610 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.715818 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.715903 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.716124 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.716217 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.716437 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.716523 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.716744 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.716829 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.717107 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.717196 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.717426 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.717515 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.717741 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.717828 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.718050 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.718136 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.718399 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.718484 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.718714 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.718806 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.719033 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.719126 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.719351 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.719438 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.719652 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.719736 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.719956 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.720050 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.720265 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.720350 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.720588 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.720681 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.720891 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.720985 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.721217 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.721305 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.721522 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.721616 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.721843 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.721937 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.722149 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.722272 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.722488 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.722622 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.722776 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.722903 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.723084 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.723183 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.723410 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.723505 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.723718 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.723869 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.724042 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.724181 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.724461 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.724546 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.724780 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.724867 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.725109 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.725198 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.725434 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.725527 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.725740 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.725834 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.726053 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.726145 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.726361 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.726446 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.726683 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.726782 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.727003 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.727090 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.727311 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.727396 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.727625 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.727711 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.727931 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.728018 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.728253 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.728340 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.728577 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.728679 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.728886 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.728972 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.729223 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.729310 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.729556 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.729663 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.729887 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.729975 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.730214 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.730300 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.730534 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.730629 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.730862 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.730956 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.731166 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.731278 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.731469 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.731606 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.731785 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.731922 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.732082 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.732246 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.732387 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.732575 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.732709 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.732887 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.733013 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.733229 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.733336 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.733530 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.733645 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.733838 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.733951 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.734147 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.734248 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.734473 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.734567 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.734783 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.734869 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.735096 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.735192 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.735407 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.735493 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.735716 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.735818 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.736022 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.736109 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.736328 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.736421 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.736629 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.736714 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.736942 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.737036 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.737274 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.737360 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.737579 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.737667 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.737883 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.737970 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.738185 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.738271 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.738505 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.738596 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.738818 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.738905 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.739129 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.739213 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.739438 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.739534 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.739748 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.739842 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.740052 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.740139 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.740379 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.740474 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.740692 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.740776 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.741004 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.741118 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.741352 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.741453 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.741675 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.741762 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.741979 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.742072 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.742282 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.742377 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.742591 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.742677 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.742895 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.742987 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.743199 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.743334 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.743501 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.743595 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.743813 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.743899 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.744117 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.744210 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.744415 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.744499 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.744714 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.744800 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.745017 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.745132 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.746104 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.746204 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.746695 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.746866 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.747004 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.747092 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.747310 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.747395 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.747617 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.747716 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.747924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.748023 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.748235 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.748318 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.748558 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.748699 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.748869 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.748954 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.749207 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.749299 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.749520 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.749619 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.749830 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.749933 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.750138 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.750223 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.750463 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.750551 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.750781 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.750868 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.751098 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.751184 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.751414 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.751501 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.751729 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.751816 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.752041 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.752124 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.752353 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.752438 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.752672 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.752757 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.752985 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.753116 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.753327 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.753413 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.753639 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.753730 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.753952 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.754035 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.754271 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.754469 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.754590 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.754800 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.754893 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.755118 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.755207 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.755434 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.755528 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.755748 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.755842 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.756062 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.756316 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.756411 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.756650 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.756737 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.756971 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.757089 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.757310 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.757408 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.757622 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.757709 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.757937 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.758022 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.758255 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.758341 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.758569 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.758652 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.758887 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.758989 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.759201 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.759295 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.759512 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.759604 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.759830 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.759924 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.760144 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.760243 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.760467 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.760560 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.760817 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.760929 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.761687 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.761786 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.762009 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.762106 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.762330 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.762423 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.762641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.762726 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.762952 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.763044 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.763262 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.763349 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.763577 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.763672 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.763895 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.763983 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.764205 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.764291 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.764516 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.764603 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.764825 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.764911 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.765166 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.765256 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.765486 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.765584 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.765801 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.765896 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.766114 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.766200 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.766423 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.766526 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.766735 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.766819 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.767047 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.767133 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.767368 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.767568 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.767711 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.767885 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.768034 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.768218 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.768350 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.768545 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.768666 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.768867 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.768986 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.769204 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.769522 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.769609 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.769839 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.769924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.770142 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.770226 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.770447 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.770535 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.770758 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.770844 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.771067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.771153 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.771372 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.771459 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.771695 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.771789 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.772006 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.772105 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.772310 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.772403 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.772625 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.772710 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.772932 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.773024 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.773261 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.773490 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.773613 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.773837 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.773930 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.774157 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.774244 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.774483 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.774575 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.774797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.774882 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.775110 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.775331 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.775417 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.775678 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.775763 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.775997 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.776085 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.776304 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.776451 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.776642 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.776737 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.776953 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.777040 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.777281 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.777375 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.777584 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.777671 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.777893 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.777980 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.778201 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.778288 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.778505 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.778600 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.778815 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.778901 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.779115 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.779209 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.779416 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.779515 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.779727 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.779819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.780032 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.780118 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.780336 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.780433 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.780641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.780734 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.780945 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.781028 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.781272 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.781373 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.781578 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.781664 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.781882 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.781969 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.782187 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.782272 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.782486 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.782578 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.782796 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.782883 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.783101 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.783193 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.783409 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.783495 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.783713 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.783797 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.784025 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.784112 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.784329 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.784414 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.784643 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.784742 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.784954 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.785041 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.785288 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.785385 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.785593 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.785678 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.785900 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.785986 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.786223 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.786309 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.786534 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.786629 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.786845 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.786938 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.787151 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.787242 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.787474 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.787574 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.787796 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.788018 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.788115 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.788336 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.788424 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.788659 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.788747 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.788990 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.789141 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.789350 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.789439 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.789660 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.789906 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.789993 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.790246 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.790349 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.790571 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.790657 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.790883 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.790970 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.791194 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.791280 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.791505 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.791592 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.791818 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.791904 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.792154 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.792250 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.792465 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.792559 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.792773 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.792860 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.793106 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.793236 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.793421 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.793522 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.793733 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.793882 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.794038 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.794137 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.794337 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.794425 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.794640 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.794735 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.794951 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.795048 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.795267 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.795355 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.795580 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.795666 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.795894 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.795980 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.796203 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.796297 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.796516 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.796640 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.796824 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.796918 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.797157 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.797245 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.797486 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.797574 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.797776 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.797864 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.798093 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.798179 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.798422 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.798518 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.798733 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.798817 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.799034 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.799119 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.799345 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.799489 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.799657 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.799787 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.799974 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.800104 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.800307 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.800411 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.800624 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.800711 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.800930 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.801017 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.801279 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.801369 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.801590 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.801676 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.801909 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.802003 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.802219 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.802307 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.802547 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.802633 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.802884 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.802970 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.803204 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.803290 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.803519 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.803605 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.803826 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.803964 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.804131 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.804218 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.804434 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.804520 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.804744 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.804839 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.805075 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.805165 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.805391 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.805477 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.805695 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.805794 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.805996 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.806082 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.806304 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.806389 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.806607 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.806742 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.806911 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.806996 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.807213 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.807307 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.807517 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.807602 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.808333 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.808422 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.808638 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.808724 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.808940 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.809034 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.809269 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.809362 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.809568 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.809654 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.809871 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.809957 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.810168 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.810252 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.810475 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.810575 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.810771 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.810865 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.811072 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.811156 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.811369 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.811462 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.811670 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.811754 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.811967 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.812050 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.812274 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.812366 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.812580 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.812665 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.812886 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.812979 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.813237 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.813408 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.813547 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.813635 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.813868 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.813952 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.814173 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.814317 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.814497 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.814584 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.814816 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.814910 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.815128 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.815222 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.815437 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.815521 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.815762 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.815849 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.816069 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.816155 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.816379 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.816465 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.816690 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.816777 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.817002 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.817126 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.817335 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.817419 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.817641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.817725 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.817968 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.818055 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.818289 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.818372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.818595 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.818689 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.818904 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.818989 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.819219 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.819306 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.819531 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.819626 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.819844 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.819929 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.820157 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.820253 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.820470 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.820572 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.820779 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.820864 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.821109 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.821201 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.821427 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.821522 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.821736 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.821862 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.822045 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.822139 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.822358 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.822446 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.822669 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.822756 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.822984 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.823069 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.823345 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.823943 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.824172 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.824258 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.824487 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.824586 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.824806 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.824899 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.825154 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.825242 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.825487 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.825583 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.825817 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.825903 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.826129 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.826216 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.826439 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.826533 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.826748 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.826844 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.827055 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.827150 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.827298 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 16:12:54.827399 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.827735 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.828069 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.828387 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.828701 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.829009 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:12:54.829277 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 16:12:54.888234 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Registered counter for database nova_api Jul 12 16:12:54.890645 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Registered counter for database nova_api Jul 12 16:12:55.001393 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.003130 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.007803 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.009651 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.062691 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.context [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02b9952f-784f-4d3b-9d9e-620e0dcce44e(cell1) {{(pid=103264) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 16:12:55.064730 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.context [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02b9952f-784f-4d3b-9d9e-620e0dcce44e(cell1) {{(pid=103265) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 16:12:55.066948 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:12:55.068526 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:12:55.068688 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:12:55.069337 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:12:55.070287 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:12:55.071089 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:12:55.071397 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:12:55.073217 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:12:55.073422 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Registered counter for database nova_cell0 Jul 12 16:12:55.075666 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Registered counter for database nova_cell0 Jul 12 16:12:55.077701 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Registered counter for database nova_cell1 Jul 12 16:12:55.079601 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Registered counter for database nova_cell1 Jul 12 16:12:55.085083 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.086480 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.088104 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.091357 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.092690 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.095180 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.096210 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.233113 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.243133 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Registered counter for database nova_cell0 Jul 12 16:12:55.246689 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Registered counter for database nova_cell0 Jul 12 16:12:55.252560 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.255971 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:12:55.256888 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.260237 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:12:55.588505 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:12:55.590658 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:12:55.596195 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:12:55.597930 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:12:55.933668 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:12:55.936939 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:12:55.939560 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:12:55.942825 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:12:55.944732 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdca68d9c0 pid: 103264 (default app) Jul 12 16:12:55.946803 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:12:55.947975 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdca68d9c0 pid: 103265 (default app) Jul 12 16:12:55.948067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-f0e5f724-4634-46f9-8795-8398590aacd3 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001700 Jul 12 16:12:55.948420 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Jul 12 16:12:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:11.161275 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:11.162478 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Jul 12 16:14:11.163124 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:11.174469 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:11.175408 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell1:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:11.176244 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell0:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:11.176956 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:12.019196 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-74eabf13-5f30-42ca-a8f9-f0fe31c089c1 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:12.050189 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-74eabf13-5f30-42ca-a8f9-f0fe31c089c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.881222 Jul 12 16:14:12.051076 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 16:14:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:14:14.291044 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:14.292069 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8239493f-77a8-47af-bdbb-c03f61bf845f None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 12 16:14:14.292424 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:14.718456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-868bc874-c924-41fa-bfef-685006f8c7ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:14.736982 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:14:14.736982 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: warnings.warn(msg) Jul 12 16:14:14.765947 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-868bc874-c924-41fa-bfef-685006f8c7ec admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.467282 Jul 12 16:14:14.769245 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:14.780078 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=3 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:14.782946 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell0:SELECT=3 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:14.782946 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell1:SELECT=3 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:14.783279 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:14.989011 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-f07593c2-62bb-44ad-b9c3-6f821e6853b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:14.991477 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:14:14.991477 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 12 16:14:15.057968 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-f07593c2-62bb-44ad-b9c3-6f821e6853b0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283095 Jul 12 16:14:15.065344 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 16:14:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:14:17.318004 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-868bc874-c924-41fa-bfef-685006f8c7ec admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:17.319639 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-868bc874-c924-41fa-bfef-685006f8c7ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Jul 12 16:14:17.320490 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:17.960017 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ad1371b3-fbc3-4a22-aeab-2739a4d41fee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:17.978452 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:14:17.978452 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 12 16:14:18.001405 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-ad1371b3-fbc3-4a22-aeab-2739a4d41fee admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.674092 Jul 12 16:14:18.002158 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 16:14:18.013994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-102ed438-22af-4da0-8988-e67c25a2be0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:18.015724 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:14:18.015724 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: warnings.warn(msg) Jul 12 16:14:18.050800 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-102ed438-22af-4da0-8988-e67c25a2be0c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040458 Jul 12 16:14:18.052023 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 16:14:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:14:20.271337 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ad1371b3-fbc3-4a22-aeab-2739a4d41fee admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:20.272380 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-ad1371b3-fbc3-4a22-aeab-2739a4d41fee admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 12 16:14:20.281140 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:20.707619 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b48e917a-b9f7-4397-b16c-6dfaacf8a3c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:20.726297 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b48e917a-b9f7-4397-b16c-6dfaacf8a3c2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447672 Jul 12 16:14:20.727295 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:20.741920 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-4229737f-d6b5-4dcd-9509-a0df4e52f1e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:20.764512 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-4229737f-d6b5-4dcd-9509-a0df4e52f1e6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026363 Jul 12 16:14:20.765092 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 16:14:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:14:22.963046 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b48e917a-b9f7-4397-b16c-6dfaacf8a3c2 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:22.964056 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b48e917a-b9f7-4397-b16c-6dfaacf8a3c2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 12 16:14:22.964443 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:23.389030 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-6d0856c3-0d19-4525-abc3-bd5eb91bf81c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "disk": 10}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:23.406001 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-6d0856c3-0d19-4525-abc3-bd5eb91bf81c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434488 Jul 12 16:14:23.406710 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:23.418278 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b2a4cea4-4c71-4200-895b-890f1d92b871 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:23.462493 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b2a4cea4-4c71-4200-895b-890f1d92b871 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047752 Jul 12 16:14:23.465133 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 16:14:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:14:25.681135 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-6d0856c3-0d19-4525-abc3-bd5eb91bf81c admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:25.682146 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-6d0856c3-0d19-4525-abc3-bd5eb91bf81c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 12 16:14:25.682810 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:26.112391 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ccde7437-44b7-4b58-a191-75829a495c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:26.130840 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ccde7437-44b7-4b58-a191-75829a495c17 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442430 Jul 12 16:14:26.131396 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:26.144078 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-91673b2d-827e-415c-bcaf-eec9cd742053 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:26.168457 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-91673b2d-827e-415c-bcaf-eec9cd742053 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028410 Jul 12 16:14:26.175059 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 16:14:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:14:28.640528 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ccde7437-44b7-4b58-a191-75829a495c17 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:28.641604 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ccde7437-44b7-4b58-a191-75829a495c17 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 12 16:14:28.642040 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:29.048782 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-6f576666-cdf0-4482-ad1c-b936541fa22a admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:29.072230 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-6f576666-cdf0-4482-ad1c-b936541fa22a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.422875 Jul 12 16:14:29.073010 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 16:14:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:14:31.298520 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ccde7437-44b7-4b58-a191-75829a495c17 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:31.299888 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ccde7437-44b7-4b58-a191-75829a495c17 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Jul 12 16:14:31.300451 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:31.714860 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0f7d408f-eec1-41c7-9a05-299288823bac admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "ram": 512}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:31.732297 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0f7d408f-eec1-41c7-9a05-299288823bac admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426065 Jul 12 16:14:31.732851 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:31.744562 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-5ef461ab-a3ee-426d-8b05-f685e5bd341a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:31.767001 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-5ef461ab-a3ee-426d-8b05-f685e5bd341a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026029 Jul 12 16:14:31.767577 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 16:14:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:14:33.967539 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0f7d408f-eec1-41c7-9a05-299288823bac admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:33.968536 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0f7d408f-eec1-41c7-9a05-299288823bac admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 12 16:14:33.968936 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:34.364487 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-37c5011a-8d56-430f-992b-7f3854ab987b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "2", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:34.383282 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-37c5011a-8d56-430f-992b-7f3854ab987b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408452 Jul 12 16:14:34.383768 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 16:14:34.395547 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-c8cbc11d-a1bf-4dfb-9f6b-ca0139742368 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:34.418090 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-c8cbc11d-a1bf-4dfb-9f6b-ca0139742368 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026295 Jul 12 16:14:34.418635 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 16:14:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:14:36.633009 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-37c5011a-8d56-430f-992b-7f3854ab987b admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:36.634140 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-37c5011a-8d56-430f-992b-7f3854ab987b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Jul 12 16:14:36.634625 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:36.998884 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-84c6fe6e-d366-4d4b-abc0-31ece68bfe2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:37.018607 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-84c6fe6e-d366-4d4b-abc0-31ece68bfe2d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.377803 Jul 12 16:14:37.019163 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:37.030831 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c3a51cbb-91c7-4f53-a501-3b82af8aa863 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:37.052524 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-c3a51cbb-91c7-4f53-a501-3b82af8aa863 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025296 Jul 12 16:14:37.053114 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 16:14:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:14:39.411680 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-84c6fe6e-d366-4d4b-abc0-31ece68bfe2d admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:39.412691 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-84c6fe6e-d366-4d4b-abc0-31ece68bfe2d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 12 16:14:39.413113 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:39.859607 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-d2d3c5cf-3e16-4cc5-830f-dd31a6f1a6e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:39.880411 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-d2d3c5cf-3e16-4cc5-830f-dd31a6f1a6e4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460403 Jul 12 16:14:39.880961 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:39.893256 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-82d7df28-3450-4de1-97d3-73d028b0cbd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:39.920278 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-82d7df28-3450-4de1-97d3-73d028b0cbd7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030736 Jul 12 16:14:39.921141 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 16:14:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:14:42.167019 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-d2d3c5cf-3e16-4cc5-830f-dd31a6f1a6e4 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:14:42.168166 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-d2d3c5cf-3e16-4cc5-830f-dd31a6f1a6e4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Jul 12 16:14:42.168653 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:14:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:14:42.660667 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55ae421f-3582-4f62-aa97-5bd26cbcd709 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:42.679637 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55ae421f-3582-4f62-aa97-5bd26cbcd709 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.485489 Jul 12 16:14:42.680463 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 16:14:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:14:42.692431 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-414b0ed0-2ccb-46b6-b36b-51b962a2c97e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:14:42.696779 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:42.723212 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-414b0ed0-2ccb-46b6-b36b-51b962a2c97e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034545 Jul 12 16:14:42.724077 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 16:14:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:15:02.285184 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55ae421f-3582-4f62-aa97-5bd26cbcd709 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:02.286192 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55ae421f-3582-4f62-aa97-5bd26cbcd709 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 12 16:15:02.286585 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:02.296627 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:15:02.674908 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-6a2adcff-d767-49da-8f81-b3db02111690 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:02.691819 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-6a2adcff-d767-49da-8f81-b3db02111690 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399647 Jul 12 16:15:02.692364 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 16:15:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:15:03.748386 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55ae421f-3582-4f62-aa97-5bd26cbcd709 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:03.749425 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55ae421f-3582-4f62-aa97-5bd26cbcd709 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 12 16:15:03.749813 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:04.263445 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c6339687-568e-4842-bd50-3c6a86e9324c admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:04.268938 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-c6339687-568e-4842-bd50-3c6a86e9324c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c6339687-568e-4842-bd50-3c6a86e9324c admin admin] Request method failure captured: Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Accept: application/json Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Host: 10.222.0.20 Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABizZ4HuNvUTJWF_6blD-Flb2G6LaobJLsHnU64fbfWtk985dYuPKU8k8q1QQVQsQndlybQIhUYxH5i_VV1XTk_3Hjxd_AO0p8gWyjzVlj3axyvvw-K98C4E1eId7wppmuIRl4__m5S1v8u_do8mK9xvwBQtO3z4Vb_PkSdT3CTGigIIyY Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Role: reader,admin,member Jul 12 16:15:04.272231 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Roles: reader,admin,member Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9c2ab2b7974c22a2f2ea682bc2117e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User: admin Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Id: cc51d173746c44518293a80aa89a28a6 Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: method: > Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: exception: Flavor 42 could not be found. Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: action_args: {'id': '42'} Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:15:04.273924 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:04.275067 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.276470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c6339687-568e-4842-bd50-3c6a86e9324c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:15:04.277835 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-c6339687-568e-4842-bd50-3c6a86e9324c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387707 Jul 12 16:15:04.277835 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 16:15:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 16:15:04.283176 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-97c8d1c6-6c2b-428f-ab1d-ab291bdc921a admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:04.286286 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:15:04.306063 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-97c8d1c6-6c2b-428f-ab1d-ab291bdc921a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026418 Jul 12 16:15:04.306601 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 16:15:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:15:04.316048 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-03d027b2-cc7c-4005-8bdb-076ee447fe66 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:04.336887 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-03d027b2-cc7c-4005-8bdb-076ee447fe66 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024347 Jul 12 16:15:04.337470 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 16:15:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:15:04.346836 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ebc8920f-506a-4be3-a4c9-0c7efb410e9d admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:04.353822 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-ebc8920f-506a-4be3-a4c9-0c7efb410e9d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ebc8920f-506a-4be3-a4c9-0c7efb410e9d admin admin] Request method failure captured: Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Accept: application/json Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Connection: keep-alive Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Content-Length: 0 Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Host: 10.222.0.20 Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABizZ4HuNvUTJWF_6blD-Flb2G6LaobJLsHnU64fbfWtk985dYuPKU8k8q1QQVQsQndlybQIhUYxH5i_VV1XTk_3Hjxd_AO0p8gWyjzVlj3axyvvw-K98C4E1eId7wppmuIRl4__m5S1v8u_do8mK9xvwBQtO3z4Vb_PkSdT3CTGigIIyY Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Domain-Id: None Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Domain-Name: None Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Name: admin Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Role: reader,admin,member Jul 12 16:15:04.357182 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Roles: reader,admin,member Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9c2ab2b7974c22a2f2ea682bc2117e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant: admin Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User: admin Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Id: cc51d173746c44518293a80aa89a28a6 Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Name: admin Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: method: > Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: exception: Flavor 42 could not be found. Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: action_args: {'id': '42'} Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:15:04.358819 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:04.359923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:04.361240 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ebc8920f-506a-4be3-a4c9-0c7efb410e9d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:15:04.362451 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-ebc8920f-506a-4be3-a4c9-0c7efb410e9d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015273 Jul 12 16:15:04.362451 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 16:15:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 16:15:05.310980 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-03d027b2-cc7c-4005-8bdb-076ee447fe66 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:05.311988 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-03d027b2-cc7c-4005-8bdb-076ee447fe66 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 12 16:15:05.312395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:05.828093 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-f97db796-e659-465f-a7cb-1c34139bfc6b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:05.833333 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-f97db796-e659-465f-a7cb-1c34139bfc6b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-f97db796-e659-465f-a7cb-1c34139bfc6b admin admin] Request method failure captured: Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Accept: application/json Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Connection: keep-alive Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Content-Length: 0 Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Host: 10.222.0.20 Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABizZ4Jd4xo58KgEGOa3ePRmyUvpzrlckV0VWBO8vO8ua8uYk-KWyTTtZgaeBqvKOYytUky-g1xPD10QyMj6kYxQeGhykQbtjO5hTYsHBKU6jxaqhx-o5hD_k7ncFyJW-AuhT_2p9edUZcVaEPf-bmL7M7hCKj2doog3UPG2V2jDqaCrNk Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Domain-Id: None Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Domain-Name: None Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Name: admin Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Role: reader,admin,member Jul 12 16:15:05.834859 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Roles: reader,admin,member Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9c2ab2b7974c22a2f2ea682bc2117e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant: admin Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User: admin Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Id: cc51d173746c44518293a80aa89a28a6 Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Name: admin Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: method: > Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: exception: Flavor 84 could not be found. Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: action_args: {'id': '84'} Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:15:05.836362 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:05.837372 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.838647 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-f97db796-e659-465f-a7cb-1c34139bfc6b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:15:05.839874 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-f97db796-e659-465f-a7cb-1c34139bfc6b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.384860 Jul 12 16:15:05.839874 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 16:15:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 16:15:05.845704 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-31093cde-b16e-4f4d-a85f-7d707d9f0ce0 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:05.859527 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-31093cde-b16e-4f4d-a85f-7d707d9f0ce0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017287 Jul 12 16:15:05.859996 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 16:15:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:15:05.869888 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-c749bfa0-abd6-499f-a290-608fb1fd08e7 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:05.883241 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-c749bfa0-abd6-499f-a290-608fb1fd08e7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017642 Jul 12 16:15:05.883754 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 16:15:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:15:05.895161 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-249c0ef5-2ab5-46df-a52c-ba4526bda0d2 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:05.900477 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-249c0ef5-2ab5-46df-a52c-ba4526bda0d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-249c0ef5-2ab5-46df-a52c-ba4526bda0d2 admin admin] Request method failure captured: Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Accept: application/json Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Host: 10.222.0.20 Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABizZ4Jd4xo58KgEGOa3ePRmyUvpzrlckV0VWBO8vO8ua8uYk-KWyTTtZgaeBqvKOYytUky-g1xPD10QyMj6kYxQeGhykQbtjO5hTYsHBKU6jxaqhx-o5hD_k7ncFyJW-AuhT_2p9edUZcVaEPf-bmL7M7hCKj2doog3UPG2V2jDqaCrNk Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Role: reader,admin,member Jul 12 16:15:05.901994 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Roles: reader,admin,member Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9c2ab2b7974c22a2f2ea682bc2117e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User: admin Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Id: cc51d173746c44518293a80aa89a28a6 Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: method: > Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: exception: Flavor 84 could not be found. Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: action_args: {'id': '84'} Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:15:05.903456 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:05.904395 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:05.905713 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-249c0ef5-2ab5-46df-a52c-ba4526bda0d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:15:05.906920 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-249c0ef5-2ab5-46df-a52c-ba4526bda0d2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011688 Jul 12 16:15:05.906920 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 16:15:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 16:15:06.862672 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-c749bfa0-abd6-499f-a290-608fb1fd08e7 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:06.863679 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-c749bfa0-abd6-499f-a290-608fb1fd08e7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 12 16:15:06.864077 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:07.380195 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-2968e776-597a-41cf-a98b-56fb7ac04cd1 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:07.385882 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-2968e776-597a-41cf-a98b-56fb7ac04cd1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-2968e776-597a-41cf-a98b-56fb7ac04cd1 admin admin] Request method failure captured: Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Accept: application/json Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Host: 10.222.0.20 Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABizZ4Kqlt9SlJpmcLTjC3gVR9rnFdKLHWyRu2YPBJS1PACemQ-gfV2PhZQkCNz3TCZrQ-d-o-5uXlSS-Ufxhrh4F5dCou0JEEW4AhXR5PlGwKeYt_qIyhgq-cSzL_qNNs5J03nsaBXogLSc6RxZGKWCAEzdZaktJ1QORJukkSHhCmFrbQ Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Role: reader,admin,member Jul 12 16:15:07.387367 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Roles: reader,admin,member Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9c2ab2b7974c22a2f2ea682bc2117e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User: admin Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Id: cc51d173746c44518293a80aa89a28a6 Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: method: > Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: exception: Flavor 451 could not be found. Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: action_args: {'id': '451'} Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:15:07.388784 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:07.389641 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.391078 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-2968e776-597a-41cf-a98b-56fb7ac04cd1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:15:07.392316 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-2968e776-597a-41cf-a98b-56fb7ac04cd1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387552 Jul 12 16:15:07.392316 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 16:15:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 16:15:07.398253 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-5a1148f5-8ad6-47cb-9363-bbd3ca2bd544 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:07.411601 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-5a1148f5-8ad6-47cb-9363-bbd3ca2bd544 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016959 Jul 12 16:15:07.412116 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 16:15:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:15:07.421580 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:07.436483 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018368 Jul 12 16:15:07.436993 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 16:15:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:15:07.445923 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-d559dfe3-b597-4a2d-b59b-eeb5cfbb9993 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:07.451190 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-d559dfe3-b597-4a2d-b59b-eeb5cfbb9993 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-d559dfe3-b597-4a2d-b59b-eeb5cfbb9993 admin admin] Request method failure captured: Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Accept: application/json Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Connection: keep-alive Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Content-Length: 0 Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Host: 10.222.0.20 Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABizZ4Kqlt9SlJpmcLTjC3gVR9rnFdKLHWyRu2YPBJS1PACemQ-gfV2PhZQkCNz3TCZrQ-d-o-5uXlSS-Ufxhrh4F5dCou0JEEW4AhXR5PlGwKeYt_qIyhgq-cSzL_qNNs5J03nsaBXogLSc6RxZGKWCAEzdZaktJ1QORJukkSHhCmFrbQ Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Domain-Id: None Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Domain-Name: None Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Project-Name: admin Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Role: reader,admin,member Jul 12 16:15:07.452665 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Roles: reader,admin,member Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9c2ab2b7974c22a2f2ea682bc2117e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9c2ab2b7974c22a2f2ea682bc2117e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant: admin Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant-Id: 0e9c2ab2b7974c22a2f2ea682bc2117e Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User: admin Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Id: cc51d173746c44518293a80aa89a28a6 Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: X-User-Name: admin Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: method: > Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: exception: Flavor 451 could not be found. Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: action_args: {'id': '451'} Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:15:07.454394 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:07.455365 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 12 16:15:07.456797 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-d559dfe3-b597-4a2d-b59b-eeb5cfbb9993 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:15:07.458054 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-d559dfe3-b597-4a2d-b59b-eeb5cfbb9993 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011631 Jul 12 16:15:07.458054 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 16:15:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 16:15:08.407701 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:08.408701 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 12 16:15:08.409146 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:08.923222 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-31df2e49-a152-4336-b28b-7b57b0a1c76e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:15:08.940837 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-31df2e49-a152-4336-b28b-7b57b0a1c76e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.395879 Jul 12 16:15:08.941415 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 16:15:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 16:15:09.902337 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:09.903486 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 12 16:15:09.903881 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:10.417597 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-6bc3b628-784e-47cf-838f-0012d6410db0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:15:10.434207 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-6bc3b628-784e-47cf-838f-0012d6410db0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.392859 Jul 12 16:15:10.434742 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 16:15:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:15:11.396449 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:11.397506 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 12 16:15:11.397903 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:11.926425 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-2bae4430-0430-464a-821d-c5b475ff6183 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:15:11.944284 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-2bae4430-0430-464a-821d-c5b475ff6183 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.408849 Jul 12 16:15:11.944852 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 16:15:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 16:15:12.906379 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:12.907366 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jul 12 16:15:12.907749 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:15:13.425068 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-3310d77e-3dac-450c-a1c4-3d4776fcbf2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:15:13.443945 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-3310d77e-3dac-450c-a1c4-3d4776fcbf2e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400604 Jul 12 16:15:13.444493 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 16:15:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:15:14.401710 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:14.402707 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 12 16:15:14.403095 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:15:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:15:14.929205 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-31cafd1e-3d28-48b9-ba2b-6756bbd8a9f1 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:15:14.947943 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-31cafd1e-3d28-48b9-ba2b-6756bbd8a9f1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408325 Jul 12 16:15:14.948477 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Jul 12 16:15:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:16:06.921719 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:16:06.922720 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-25a8bdd4-5c6a-4179-910a-78cdc7581ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 12 16:16:06.923108 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 16:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:16:06.933211 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:16:07.307710 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-44465bf0-6ca5-417a-9e4b-a8198bfaf4cf admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:16:07.326350 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-44465bf0-6ca5-417a-9e4b-a8198bfaf4cf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397596 Jul 12 16:16:07.326896 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 16:16:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:16:07.350119 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-f35a0927-323b-4993-9bd3-bf43ce180e32 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:16:07.353492 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=14 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:16:07.359097 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-f35a0927-323b-4993-9bd3-bf43ce180e32 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013003 Jul 12 16:16:07.359603 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 12 16:16:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:16:07.371345 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-533e2697-4a1e-4ce4-9852-0f7db5928b3f admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:16:07.378895 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-533e2697-4a1e-4ce4-9852-0f7db5928b3f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011245 Jul 12 16:16:07.379397 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 12 16:16:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:16:07.390282 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:16:07.397543 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010674 Jul 12 16:16:07.398050 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 12 16:16:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:16:07.408557 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-b0f0db70-c73c-4c1f-8269-772cbf954951 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:16:07.416327 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-b0f0db70-c73c-4c1f-8269-772cbf954951 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011120 Jul 12 16:16:07.416835 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 12 16:16:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:19:39.117077 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:39.118342 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Jul 12 16:19:39.118738 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:19:39.259049 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=6 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:19:39.416667 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-77d3fee3-e949-4517-a51f-185c4a4a2dd1 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:39.417903 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:19:39.417903 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 12 16:19:39.419123 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-77d3fee3-e949-4517-a51f-185c4a4a2dd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:39.419642 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-77d3fee3-e949-4517-a51f-185c4a4a2dd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:39.420430 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-77d3fee3-e949-4517-a51f-185c4a4a2dd1 admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:39.420857 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-77d3fee3-e949-4517-a51f-185c4a4a2dd1 admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:39.455036 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-77d3fee3-e949-4517-a51f-185c4a4a2dd1 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.197271 Jul 12 16:19:39.455499 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 16:19:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:19:40.274968 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:40.275991 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 12 16:19:40.276378 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:19:40.466606 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a66809e3-b7c7-4566-b33d-553f87c2f156 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:40.467814 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:19:40.467814 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 12 16:19:40.469418 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a66809e3-b7c7-4566-b33d-553f87c2f156 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:40.470056 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a66809e3-b7c7-4566-b33d-553f87c2f156 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:40.471494 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a66809e3-b7c7-4566-b33d-553f87c2f156 admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:40.471937 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a66809e3-b7c7-4566-b33d-553f87c2f156 admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:40.493484 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-a66809e3-b7c7-4566-b33d-553f87c2f156 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078495 Jul 12 16:19:40.494051 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 16:19:40 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:19:51.740100 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:51.741117 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 12 16:19:51.741515 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:19:51.887864 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell0:SELECT=4 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:19:51.888597 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell1:SELECT=4 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:19:51.889236 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=8 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:19:51.937743 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a04d7f32-7ad7-41e3-b826-033f4675fb6d admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:51.938915 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:19:51.938915 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 12 16:19:51.940092 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a04d7f32-7ad7-41e3-b826-033f4675fb6d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:51.940530 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a04d7f32-7ad7-41e3-b826-033f4675fb6d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:51.941339 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a04d7f32-7ad7-41e3-b826-033f4675fb6d admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:51.941768 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-a04d7f32-7ad7-41e3-b826-033f4675fb6d admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:51.967000 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-a04d7f32-7ad7-41e3-b826-033f4675fb6d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083424 Jul 12 16:19:51.967474 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 16:19:51 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:19:52.803779 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:52.804775 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ab6059bd-0bcc-467a-9b66-60c806afe1dc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 12 16:19:52.805198 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 16:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:19:52.995954 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-6d69e31c-c2ec-4cb8-a82c-47032dfa4b79 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:19:52.997171 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:19:52.997171 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 12 16:19:52.998368 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-6d69e31c-c2ec-4cb8-a82c-47032dfa4b79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:52.998804 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-6d69e31c-c2ec-4cb8-a82c-47032dfa4b79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:52.999611 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-6d69e31c-c2ec-4cb8-a82c-47032dfa4b79 admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:19:53.000056 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-6d69e31c-c2ec-4cb8-a82c-47032dfa4b79 admin admin] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:19:53.021466 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-6d69e31c-c2ec-4cb8-a82c-47032dfa4b79 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076378 Jul 12 16:19:53.021940 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 16:19:52 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:20:50.998644 dv-cinder-797608-56-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 16:20:51.000485 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: Tue Jul 12 16:20:51 2022 - graceful shutdown triggered... Jul 12 16:20:51.000985 dv-cinder-797608-56-iscsi devstack@n-api.service[103264]: Gracefully killing worker 1 (pid: 103264)... Jul 12 16:20:51.001492 dv-cinder-797608-56-iscsi devstack@n-api.service[103265]: Gracefully killing worker 2 (pid: 103265)... Jul 12 16:20:52.001635 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: worker 1 buried after 1 seconds Jul 12 16:20:52.001635 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: worker 2 buried after 1 seconds Jul 12 16:20:52.003289 dv-cinder-797608-56-iscsi devstack@n-api.service[103263]: goodbye to uWSGI. Jul 12 16:20:52.003256 dv-cinder-797608-56-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 16:20:52.003813 dv-cinder-797608-56-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 16:20:52.006873 dv-cinder-797608-56-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 16:20:52.016467 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 16:20:52 2022] *** Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: nodename: dv-cinder-797608-56-iscsi Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: machine: x86_64 Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: clock source: unix Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: pcre jit disabled Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: detected number of CPU cores: 4 Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: current working directory: / Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: detected binary path: /usr/bin/uwsgi-core Jul 12 16:20:52.018464 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: your processes number limit is 47680 Jul 12 16:20:52.019324 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: your memory page size is 4096 bytes Jul 12 16:20:52.019324 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: detected max file descriptor number: 2048 Jul 12 16:20:52.019324 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: lock engine: pthread robust mutexes Jul 12 16:20:52.019324 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: thunder lock: enabled Jul 12 16:20:52.019324 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 16:20:52.019324 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 16:20:52.063990 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: Python main interpreter initialized at 0x5614e8e7d9c0 Jul 12 16:20:52.063990 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: python threads support enabled Jul 12 16:20:52.063990 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: your server socket listen backlog is limited to 100 connections Jul 12 16:20:52.063990 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: your mercy for graceful operations on workers is 90 seconds Jul 12 16:20:52.064438 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 16:20:52.064438 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: *** Operational MODE: preforking *** Jul 12 16:20:52.064701 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: *** uWSGI is running in multiple interpreter mode *** Jul 12 16:20:52.064701 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: spawned uWSGI master process (pid: 117778) Jul 12 16:20:52.068568 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: spawned uWSGI worker 1 (pid: 117791, cores: 1) Jul 12 16:20:52.068568 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: spawned uWSGI worker 2 (pid: 117792, cores: 1) Jul 12 16:20:52.068568 dv-cinder-797608-56-iscsi devstack@n-api.service[117778]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 16:20:52.064892 dv-cinder-797608-56-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 16:20:52.736886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 16:20:52.740561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 16:20:53.923088 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:20:53.923088 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: from cryptography.utils import int_from_bytes Jul 12 16:20:53.923849 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:20:53.923849 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: from cryptography.utils import int_from_bytes Jul 12 16:20:53.928328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:20:53.928328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: from cryptography.utils import int_from_bytes Jul 12 16:20:53.928782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:20:53.928782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: from cryptography.utils import int_from_bytes Jul 12 16:20:56.185341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 16:20:56.185901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 16:20:56.186123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 16:20:56.186478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 16:20:56.186735 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 16:20:56.187652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.187985 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.188329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.188636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.188969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.189311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.189636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.189960 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.190297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.190559 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.190876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.191202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-56-iscsi {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.191526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.191836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.192150 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.192468 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.192776 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.193122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.193432 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.193944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.194443 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.194762 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.195075 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.195416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.195732 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.196046 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.196373 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.196683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.197011 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.197353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.197753 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-56-iscsi {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.198075 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.198391 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.198709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.199127 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.199441 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.199755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.200270 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.200602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.200918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.201277 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.201602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.201927 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.202250 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.203116 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.203438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.203746 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.204229 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.204543 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.204852 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.205291 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.205611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.205938 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.206428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.206759 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.207014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.207268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.207592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.207920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.208235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.208548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.208860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.209196 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.209510 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.209620 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 16:20:56.210018 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.210096 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 16:20:56.210179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.210378 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 16:20:56.210506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.210734 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.210844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 16:20:56.210994 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 16:20:56.211094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.211368 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.211468 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.211679 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.211769 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.211999 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.212106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.212348 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.212446 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.212646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.212743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.212959 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.213088 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.213328 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.213431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.213652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.213760 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.213966 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.214086 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.214242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.214342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.214564 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.214654 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.214898 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-56-iscsi {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.215004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.215211 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.215325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.215525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.215633 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.215841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.215969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.216168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.216267 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.216472 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.216577 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.216727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.216845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.217028 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.217153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.217359 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.217628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.217742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.217950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.218062 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.218289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.218387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.218599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.218689 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.218901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.219000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.219208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.219306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.219516 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.219608 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.219823 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.219920 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.220129 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.220228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.220439 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.220538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.220744 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.220841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.221132 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.221298 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-56-iscsi {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.221398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.221525 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.221676 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.221848 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.221998 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.222170 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.222320 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.222595 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.222710 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.222915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.223025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.223226 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.223332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.223552 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.223653 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.223855 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.223963 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.224175 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.224282 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.224473 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.224644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.224794 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.224886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.225130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.225239 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.225441 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.225548 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.225757 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.225854 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.226065 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.226176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.226375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.226474 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.226696 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.226801 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.226997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.227106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.227305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.227466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.227613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.227769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.227937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.228119 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.228358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.228577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.228738 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.228893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.228893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.229274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.229436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.229591 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.229748 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.229907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.230075 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.230236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.230395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.230543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.230700 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.230856 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.231017 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.231172 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.231318 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.231471 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.231617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.231769 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.231940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.232088 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.232242 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.232389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.232534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.232694 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.232841 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.232988 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.233173 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.233332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.233480 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.235620 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.235777 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.235902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.236031 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.236158 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.236279 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.236401 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.236513 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.236630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.236741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.236874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.236995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.237154 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.237272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.237383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.237493 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.237601 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.237719 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.237830 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.237939 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.238299 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.238421 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.238532 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.238650 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.238768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.238887 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.239006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.239123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.239242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.239362 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.239473 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.239589 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.239707 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.239825 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.239943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.240063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.240174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.240283 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.240392 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.240500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.240618 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.240728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.240844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.240970 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.241433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.241560 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.241680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.241791 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.241907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.241907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.242109 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.242225 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.242362 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.242670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.242794 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.242919 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.243029 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.243144 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.243281 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.243414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.243525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.243642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.243759 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.243888 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.243999 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.244107 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.244215 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.244393 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.244521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.244786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.245135 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.245314 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.245464 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.245652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.245931 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.246092 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.246240 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.246383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.246537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.246691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.246843 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.246996 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.247141 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.247284 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.247441 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.247586 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.247728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.247880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.248022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.248182 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.248550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.248724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.248878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.249030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.249208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.249986 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.250156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.250322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.250466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.250610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.250763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.250915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.251067 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.251231 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.251374 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.251525 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.251668 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.251811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.251968 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.252207 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.252363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.252515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.252665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.252817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.252970 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.253332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.253497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.253642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.253785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.253940 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.254097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.254241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.254390 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.254544 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.254695 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.254847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.255317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.255467 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.255620 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.255776 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.256061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.256220 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.256372 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.256516 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.256658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.256801 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.256952 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.257126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:20:56.257285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.257430 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.257586 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.257737 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.257902 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.258056 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.258209 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.258427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.259289 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.259461 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.259666 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.259817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.259961 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.260162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.260320 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.260464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.260627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.260779 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.260933 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.261120 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.261271 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.261415 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.261572 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.261728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.261872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.262014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.262165 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.262165 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.262447 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.262602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.262745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.262896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.263048 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.263343 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.263517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.263671 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.263815 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.264523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.264671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.264830 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.265023 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.265520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.265698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.265851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.266014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.266313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.266459 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.266603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.266745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.266888 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.267039 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.267196 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.267340 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.267483 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.267638 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.267781 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.267932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.268083 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.268226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.268368 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.268522 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.268840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.269000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.269273 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.269440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.269585 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.269730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.269884 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.270036 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.270188 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.270341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.270491 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.270636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.270786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.270944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.271095 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.271246 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.271391 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.271534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.271690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.271844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.271987 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.272130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.272271 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.272421 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.272578 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.272721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.272864 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.273006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.273199 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.273344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.273498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.273498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.273790 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.273790 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.274072 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.274072 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.274358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.274510 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.274662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.274662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.275072 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.275232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.275668 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.275821 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.275974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.276277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.276433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.276593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.276738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.276882 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.277026 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.277213 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.277366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.277525 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.277669 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.277811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.277962 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.278117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.278268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.278420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.278563 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.278714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.279041 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.279196 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.279438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.279604 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.279756 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.279908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.280051 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.280204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.280436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.280613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.280763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.280907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.281080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.281245 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.281398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.281544 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.281686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.281837 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.281988 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.282139 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.282293 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.282293 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.282584 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.282729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.282880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.283023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.283175 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.283320 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.283462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.283611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.283761 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.283914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.284108 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.284261 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.284416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.284559 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.284702 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.284858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.285187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.285639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.285802 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.285947 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.286227 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.286582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.286746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.286892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.287056 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.287208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.287359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.287512 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.287656 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.287809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.287959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.288101 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.288253 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.288501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.288665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.288818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.289198 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.289368 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.289630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.289787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.289939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.290083 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.290226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.290368 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.290519 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.290672 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.290816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.290958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.291101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.291750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.291935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.292090 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.292235 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.292378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.292529 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.292687 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.292840 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.292984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.293171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.293324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.293476 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.293633 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.293790 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.293945 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.294098 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.294241 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.294391 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.294550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.294550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.294838 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.294981 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.295130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.295282 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.295439 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.295883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.296040 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.296826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.296981 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.297166 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.297312 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.297455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.297598 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.297741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.297882 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.298035 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.298179 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.298321 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.298464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.298617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.298767 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.298919 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.299156 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.299308 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.299452 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.299702 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.299955 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.300116 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.300262 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.300412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.300555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.300555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.300845 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.301003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.301179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.301325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.301467 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.301610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.301766 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.301918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.302097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.302251 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.302537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.302696 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.302860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.303015 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.303166 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.303317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.303466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.303616 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.303768 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.303912 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.304061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.304215 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.304365 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.304515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.304665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.304819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.304968 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.305167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.305325 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.305477 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.305771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.306057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.306209 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.306519 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.306673 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.306978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.307132 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.307276 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.307432 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.307432 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.307728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.308005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.308166 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.308311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.308471 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.308624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.309343 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.309503 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.309649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.309793 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.309974 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.310232 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.310399 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.310632 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.310795 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.310947 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.311107 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.311265 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.311423 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.311583 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.311733 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.312481 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.312817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.312972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.313164 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.313327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.313477 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.313652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.313817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.313982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.314141 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.314297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.314463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.327035 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.327944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.328120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.328296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.328451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.328614 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.328776 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.328935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.329483 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.329660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.329822 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.329985 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.330137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.330304 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.330457 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.330609 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.330780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.330930 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.331081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.331232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.331388 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.331547 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.331732 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.332026 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.332198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.332352 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.332510 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.332670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.332861 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.333339 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.333711 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.333871 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.334023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.334185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.334347 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.334499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.334660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.334819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.334970 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.335131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.335283 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.335455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.335620 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.335777 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.335935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.336100 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.336260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.336411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.336561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.336719 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.336869 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.337035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.337213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.337375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.337537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.337696 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.337848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.338017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.338169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.338328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.338487 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.338646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.338805 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.338964 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.339122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.339281 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.339670 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.339841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.340107 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.340279 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.340440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.340592 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.340750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.340908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.341088 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.341255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.341407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.341407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.341693 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.341861 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.342023 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.342174 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.342323 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.342481 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.342631 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.342790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.342941 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.343418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.343418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.343911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.344071 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.344233 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.344396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.344546 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.344696 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.344853 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.345004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.345204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.345358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.345509 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.345674 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.345827 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.345985 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.346143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.346294 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.346454 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.346614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.346766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.346916 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.347074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.347225 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.347383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.347543 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.347703 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.347854 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.348006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.348156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.348306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.348475 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.348627 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.348785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.348943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.349118 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.349291 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.349444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.349947 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.350107 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.350258 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.350409 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.350570 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.350722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.350884 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.351034 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.351193 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.351352 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.351551 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.351703 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.351853 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.352009 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.352168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.352332 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.352494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.352663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.352824 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.352980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.353155 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.353612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.353779 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.354127 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.354391 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.354555 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.354715 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.354876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.355035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.355186 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.355344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.355513 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.355678 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.355845 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.356004 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.356161 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.356317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.356474 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.356639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.356804 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.356955 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.357126 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.357291 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.357442 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.357611 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.357771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.357929 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.358085 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.358242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.358400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.358564 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.361864 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.362057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.362220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.362220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.362530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.362784 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.362951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.363121 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.363679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.363847 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.364001 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.364357 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.364526 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.364526 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.364823 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.364983 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.365230 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.365391 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.365566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.365566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.365874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.365874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.366453 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.366614 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.366765 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.366916 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.367065 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.367223 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.367383 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.367534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.367683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.367844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.368001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.368158 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.368322 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.368473 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.368623 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.369398 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.369568 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.369735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.369896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.370055 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.370212 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.370365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.370526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.370692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.370844 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.371001 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.371159 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.371317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.371469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.371928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.372090 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.372253 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.372406 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.372566 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.372737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.372898 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.373074 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.373242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.373393 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.373594 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.373914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.374010 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.374096 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.374179 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.374327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.374939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375042 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375346 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375454 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375608 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375748 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375886 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.375965 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376199 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376278 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376517 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376595 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376673 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376830 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.376980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377211 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377398 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377484 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377557 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377776 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.377935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378015 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378092 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378164 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378233 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378311 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378389 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378467 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378539 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378609 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378756 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378835 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378906 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.378976 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379275 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379425 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379503 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379575 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379793 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379862 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.379938 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380281 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380355 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380504 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380814 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380898 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.380971 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381074 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381279 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381508 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.381757 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382054 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382132 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382288 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382881 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.382959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383043 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383116 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383261 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383407 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383553 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383701 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.383805 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384237 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384237 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384369 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384369 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384586 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384727 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.384957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385145 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385224 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385294 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385371 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385448 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385527 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385527 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.385971 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386049 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386119 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386195 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386272 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386343 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386425 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386740 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386888 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.386966 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387109 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387435 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387505 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387581 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387798 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387877 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.387948 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388102 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388250 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388250 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388385 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388456 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388916 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.388916 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389061 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389150 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389230 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389493 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389563 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389709 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389791 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.389863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390212 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390292 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390432 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390502 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390570 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390647 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390796 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390865 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.390940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391096 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391299 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391368 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391462 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391541 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391619 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391778 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.391857 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392151 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392403 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392481 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392553 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392709 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.392941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393243 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393385 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393464 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393549 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393775 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.393941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394319 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394392 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394547 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394768 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394917 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.394997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395152 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395229 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395307 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395385 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395541 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395611 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395679 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395748 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395830 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395910 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.395987 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396134 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396215 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396371 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396464 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396690 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396856 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.396935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397012 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397196 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397276 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397355 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397579 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397805 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397882 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.397954 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398030 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398247 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398403 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398473 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398542 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398618 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.398689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399432 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399506 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399807 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.399945 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400095 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400240 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400318 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400530 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400762 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400831 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.400983 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401075 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401161 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401240 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401319 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401399 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401471 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401547 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401625 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401792 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.401967 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.402046 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.403895 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.403977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404371 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404456 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404616 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404694 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404766 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404916 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.404986 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405134 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405225 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405308 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405380 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405450 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405525 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405699 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.405981 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406049 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406207 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406279 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406348 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406655 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406795 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406863 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.406931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407009 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407088 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407158 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407233 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407304 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407450 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407597 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407745 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407822 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.407901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408034 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408182 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408331 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408616 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408706 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408778 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408856 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.408934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409104 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409180 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409346 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409576 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409648 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409718 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409788 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409857 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.409933 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.410017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.410095 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.410167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.410454 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.410608 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.410768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.410944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.411090 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.411269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.411418 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.411609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.411752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.411951 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.412094 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.412266 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.412422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.412579 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.412746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.412890 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.413229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.413343 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.413549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.413719 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.414136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.414466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.414575 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.414664 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.414757 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.414855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.415073 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.415676 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.415800 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.415889 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.415982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.415982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.416163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.416288 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.416587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.416686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.417199 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.417324 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.417414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.417564 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.417656 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.417911 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.418149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.418254 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.418548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.418740 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.418868 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.419191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.419326 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.419505 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.419818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.419916 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.420132 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.420458 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.420579 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.420748 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.421022 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.421699 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.421942 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.422169 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.422276 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.422671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.422773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.422987 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.423270 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.423372 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.423623 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.424014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.424143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.424240 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.424588 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.424769 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.424872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.425222 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.425429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.425542 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.425877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.426030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.426221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.426553 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.426644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.426883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.427149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.427251 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.427487 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.427739 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.427838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.428096 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.428322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.428416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.428716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.428932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.429023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.429345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.429539 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.429660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.429969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.430124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.430274 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.430592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.430705 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.430884 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.431198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.431289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.431506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.431791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.431908 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.432107 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.432342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.432435 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.432712 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.432930 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.433023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.433341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.433542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.433635 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.433946 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.434197 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.434295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.434697 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.434810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.434898 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.435172 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.435279 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.435511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.435780 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.435880 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.436144 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.436379 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.436472 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.436770 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.437576 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.437730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.438018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.438126 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.438378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.438612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.438702 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.439008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.439192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.439347 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.439666 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.439764 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.439984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.440283 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.440383 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.440607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.440867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.440980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.441663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.441764 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.441852 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.441943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.442130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.442235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.442513 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.442722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.442822 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.443310 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.443427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.443525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.443771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.443876 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.444300 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.444411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.444513 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.444912 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.445020 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.445158 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.445445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.445629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.445763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.446085 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.446237 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.446405 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.446738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.446835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.447071 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.447838 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.447954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.448043 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.448136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.448136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.448365 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.448457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.448684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.448961 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.449100 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.449383 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.449584 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.449685 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.450008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.450181 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.450319 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.450567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 16:20:56.450813 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.451254 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.451943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.452394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.452857 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.453348 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.453803 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.454249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.455328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.455328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.455328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.455903 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.456339 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.456832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.457255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.457656 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.457991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.458322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.458653 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.458983 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.459313 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.459640 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.459968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.460293 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.460625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.460996 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.461381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.461716 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.462053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.462386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.462709 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.463030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.463353 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.463674 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.464000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.464345 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.464676 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.464990 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.465468 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.465796 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.466128 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.466461 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.466784 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.467119 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.467455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.467779 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.468155 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.468478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.468819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.469207 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.469550 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.469887 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.470204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.470519 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.470834 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.471153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.471485 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.471807 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.472121 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.472435 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.472755 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.473197 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.473407 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.473720 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.474034 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.474352 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.474716 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.474978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.475292 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.475605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.475913 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.476224 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.476540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.476854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.477201 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.477516 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.477832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.478144 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.478496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.478838 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.479166 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.479499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.479823 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.480213 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.480536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.480915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.481276 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.481612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.481940 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.485093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.485467 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.485818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.486160 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.486504 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.486845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.487183 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.487542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.487891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.488218 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.488567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.488910 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.489402 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.489743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.490076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.490433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.490760 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.491428 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.491766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.492100 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.492436 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.492770 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.493126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.493475 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.493819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.494146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.494488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.494833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.495211 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.495542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.495905 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.496249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.496577 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.496906 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.497256 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:20:56.497515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 16:20:56.605405 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Registered counter for database nova_api Jul 12 16:20:56.626450 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.633247 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:56.649027 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO dbcounter [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Registered counter for database nova_api Jul 12 16:20:56.668754 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.676063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writer thread running {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:56.688851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.context [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02b9952f-784f-4d3b-9d9e-620e0dcce44e(cell1) {{(pid=117792) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 16:20:56.692753 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:20:56.694361 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:20:56.695169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:20:56.697118 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:20:56.699079 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Registered counter for database nova_cell0 Jul 12 16:20:56.703080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Registered counter for database nova_cell1 Jul 12 16:20:56.711454 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.712548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.717516 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:56.720490 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:56.731924 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.context [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02b9952f-784f-4d3b-9d9e-620e0dcce44e(cell1) {{(pid=117791) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 16:20:56.736477 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:20:56.738114 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:20:56.738921 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:20:56.740873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:20:56.743139 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO dbcounter [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Registered counter for database nova_cell0 Jul 12 16:20:56.747203 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO dbcounter [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Registered counter for database nova_cell1 Jul 12 16:20:56.754375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.755704 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.762723 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writer thread running {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:56.764082 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writer thread running {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:56.864353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Registered counter for database nova_cell0 Jul 12 16:20:56.871036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.875401 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:56.911802 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO dbcounter [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Registered counter for database nova_cell0 Jul 12 16:20:56.919828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:20:56.927011 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writer thread running {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:20:57.190030 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:20:57.197338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:20:57.248463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: WARNING keystonemiddleware.auth_token [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:20:57.255999 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: WARNING keystonemiddleware.auth_token [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:20:57.539075 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:20:57.545012 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-76cd2f94-1dab-463a-b031-3df42b8632f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:20:57.550358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5614e8e7d9c0 pid: 117792 (default app) Jul 12 16:20:57.606914 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: WARNING keystonemiddleware.auth_token [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 16:20:57.612972 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: WARNING keystonemiddleware.auth_token [None req-c5a9af95-d8aa-4a96-80ae-74101bcda149 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 16:20:57.618610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5614e8e7d9c0 pid: 117791 (default app) Jul 12 16:21:38.504145 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:38.505407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:38.506617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:38.507515 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:38.881463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:38.883917 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:38.885781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:38.888939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:39.711244 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-06291abe-50bc-4473-8f06-2c342f811c6f tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Action: 'create', calling method: .version_select at 0x7f1da79475e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1801911229", "metadata": {"Type": "work"}}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:21:39.977615 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cb2abf48-de3f-4f9c-a594-b6a197e8084e tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Action: 'create', calling method: .version_select at 0x7f1da7946700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1286560060"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:21:41.351399 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-06291abe-50bc-4473-8f06-2c342f811c6f tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.864010 Jul 12 16:21:41.352834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 16:21:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2868 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 16:21:41.370025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-068b975f-c624-4a7f-b335-6871e4c8d23d tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Calling method '.version_select at 0x7f1da780d4c0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:41.477027 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cb2abf48-de3f-4f9c-a594-b6a197e8084e tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.605952 Jul 12 16:21:41.477670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Jul 12 16:21:38 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2608 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 16:21:41.491149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-19226f22-2192-4210-afe6-1dad78dd683e tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da780b550>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:41.566247 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-19226f22-2192-4210-afe6-1dad78dd683e tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e" status: 200 len: 345 microversion: 2.1 time: 0.079622 Jul 12 16:21:41.566786 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:41 2022] GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:41.589802 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-068b975f-c624-4a7f-b335-6871e4c8d23d tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb" status: 200 len: 353 microversion: 2.1 time: 0.225787 Jul 12 16:21:41.590631 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:41 2022] GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:42.596878 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c7af651b-ab60-48f5-932a-f5925a770e1c tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da780b670>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:42.606742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b2afce0d-8f5e-4a90-b9c3-ae2779708f6e tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Calling method '.version_select at 0x7f1da780d820>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:42.724218 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c7af651b-ab60-48f5-932a-f5925a770e1c tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e" status: 200 len: 346 microversion: 2.1 time: 0.148868 Jul 12 16:21:42.724565 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b2afce0d-8f5e-4a90-b9c3-ae2779708f6e tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb" status: 200 len: 354 microversion: 2.1 time: 0.122895 Jul 12 16:21:42.725193 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:42 2022] GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:42.725873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:42 2022] GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e => generated 346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:42.743605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e8ff394d-530d-4ccf-a089-ecc77443f1a3 tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Calling method '.version_select at 0x7f1da780bca0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:42.744151 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d345428b-a96b-43b3-9048-2f415d7431aa tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Action: 'create', calling method: .version_select at 0x7f1da780db80>, body: {"snapshot": {"volume_id": "f66a35b7-14a0-436d-adb4-25948c2f000e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-168537317"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:21:42.863849 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e8ff394d-530d-4ccf-a089-ecc77443f1a3 tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb" status: 200 len: 354 microversion: 2.1 time: 0.129164 Jul 12 16:21:42.864680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:42 2022] GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:42.882722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8e394132-b724-4dfb-a87c-2fb78ff179c4 tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Calling method '.version_select at 0x7f1da7825430>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:43.039884 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8e394132-b724-4dfb-a87c-2fb78ff179c4 tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb" status: 202 len: 0 microversion: 2.1 time: 0.160945 Jul 12 16:21:43.045991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:21:42 2022] DELETE /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:21:43.052264 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-41facb29-01a2-44f7-a77c-945f25a8e602 tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Calling method '.version_select at 0x7f1da780bd30>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:43.108920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d345428b-a96b-43b3-9048-2f415d7431aa tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.373582 Jul 12 16:21:43.115845 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 4/9] 10.222.0.20 () {60 vars in 1161 bytes} [Tue Jul 12 16:21:42 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:43.129795 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8f547ee2-a878-4b95-8b7c-55d98db8a0de tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da7824820>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:43.145604 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-41facb29-01a2-44f7-a77c-945f25a8e602 tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb" status: 200 len: 353 microversion: 2.1 time: 0.098464 Jul 12 16:21:43.146165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:43 2022] GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:43.201099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8f547ee2-a878-4b95-8b7c-55d98db8a0de tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 200 len: 286 microversion: 2.1 time: 0.078972 Jul 12 16:21:43.208106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:21:43 2022] GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:21:43.213936 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-94cb5d25-5647-4432-9cb0-54bddb7f686b tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da780b5e0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:43.445682 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-94cb5d25-5647-4432-9cb0-54bddb7f686b tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.236012 Jul 12 16:21:43.446751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jul 12 16:21:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:43.458639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1af48bee-ec89-4132-83da-bc8c692e65c5 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da780dd30>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:43.506086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1af48bee-ec89-4132-83da-bc8c692e65c5 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 200 len: 286 microversion: 2.1 time: 0.052711 Jul 12 16:21:43.507395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:21:43 2022] GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:44.159695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-94d57129-0c9d-4169-978b-d2ec289cb1ba tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Calling method '.version_select at 0x7f1da7825a60>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:44.210210 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-94d57129-0c9d-4169-978b-d2ec289cb1ba tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] HTTP exception thrown: Volume eec5aa9a-503c-4c25-a56d-065a8cf9d9cb could not be found. Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-94d57129-0c9d-4169-978b-d2ec289cb1ba tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Request method failure captured: Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb HTTP/1.1 Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-SdfoGBQsWoNEAvV4HQy3KMdxKajr8nm_iFn9X-ZTEHtunXF3LrCmRkSOx-0zd652ZfWURHSCRnR3RibVuOzWVFVGPXCky2zmU5UJIuymB6VJ_rDS3RzOdpqK4y8B1uoV_8Cb6cC-YhskANY080a47fztM2rQyuMZbYb81uu2I26o Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: b21cdd7b4e5a4241b0f7d52d28e756a7 Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesGetTestJSON-275453617 Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:21:44.214462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21cdd7b4e5a4241b0f7d52d28e756a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b21cdd7b4e5a4241b0f7d52d28e756a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21cdd7b4e5a4241b0f7d52d28e756a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b21cdd7b4e5a4241b0f7d52d28e756a7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesGetTestJSON-275453617 Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: b21cdd7b4e5a4241b0f7d52d28e756a7 Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesGetTestJSON-275453617 Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesGetTestJSON-275453617-project Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: e7769f93caf94bb39be56366fbae60e3 Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesGetTestJSON-275453617-project Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Volume eec5aa9a-503c-4c25-a56d-065a8cf9d9cb could not be found. Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'eec5aa9a-503c-4c25-a56d-065a8cf9d9cb'} Jul 12 16:21:44.215588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eec5aa9a-503c-4c25-a56d-065a8cf9d9cb could not be found. (HTTP 404) (Request-ID: req-25fd49bf-628d-472b-b98d-512333b6328c) Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:44.216206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:44.217650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eec5aa9a-503c-4c25-a56d-065a8cf9d9cb could not be found. Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 16:21:44.218455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eec5aa9a-503c-4c25-a56d-065a8cf9d9cb could not be found. Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eec5aa9a-503c-4c25-a56d-065a8cf9d9cb could not be found. Jul 12 16:21:44.219344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:44.220967 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-94d57129-0c9d-4169-978b-d2ec289cb1ba tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] Returning 404 to user: Volume eec5aa9a-503c-4c25-a56d-065a8cf9d9cb could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:21:44.221944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-94d57129-0c9d-4169-978b-d2ec289cb1ba tempest-VolumesGetTestJSON-275453617 tempest-VolumesGetTestJSON-275453617-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb" status: 404 len: 109 microversion: 2.1 time: 0.067559 Jul 12 16:21:44.222466 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:44 2022] GET /compute/v2.1/os-volumes/eec5aa9a-503c-4c25-a56d-065a8cf9d9cb => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:21:44.521847 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2b52598b-e7fc-47e0-a42a-bc736fc6ffb7 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da780d820>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:44.587076 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2b52598b-e7fc-47e0-a42a-bc736fc6ffb7 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 200 len: 286 microversion: 2.1 time: 0.072062 Jul 12 16:21:44.591298 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:21:44 2022] GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:45.600602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-342319f9-7b71-4a7f-b3aa-b8927575d165 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da7825e50>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:45.693227 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-342319f9-7b71-4a7f-b3aa-b8927575d165 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 200 len: 286 microversion: 2.1 time: 0.098141 Jul 12 16:21:45.697193 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:21:45 2022] GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:46.715398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1c2c4cc7-53b8-414d-be17-bce86ce608e8 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da78248b0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:46.819868 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1c2c4cc7-53b8-414d-be17-bce86ce608e8 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 200 len: 287 microversion: 2.1 time: 0.117206 Jul 12 16:21:46.827089 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:21:46 2022] GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:46.832945 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8fc4662b-425e-40ba-8fa5-7cb3792cc272 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da77905e0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:46.968954 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8fc4662b-425e-40ba-8fa5-7cb3792cc272 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 202 len: 0 microversion: 2.1 time: 0.141332 Jul 12 16:21:46.971515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1253 bytes} [Tue Jul 12 16:21:46 2022] DELETE /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:21:46.980482 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2ca23180-6f0e-4813-8595-47a651e27167 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da78240d0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:47.065172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2ca23180-6f0e-4813-8595-47a651e27167 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 200 len: 286 microversion: 2.1 time: 0.088925 Jul 12 16:21:47.071698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:21:46 2022] GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:48.077833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3d411ca8-3e87-451a-9cca-03685f452aed tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da7825e50>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:48.125844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-3d411ca8-3e87-451a-9cca-03685f452aed tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] HTTP exception thrown: Snapshot 01707cbe-05b0-405d-b529-06ed9769d0e7 could not be found. Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3d411ca8-3e87-451a-9cca-03685f452aed tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Request method failure captured: Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 HTTP/1.1 Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-Sk0oA78wfjJqiAUMqeE8PhiFmV6PZlQZ2dKgj1wjMdkFa0hH9gL40OLTD8TvQX-cKt5DilEKL6yjcfCVqSNqNPxWsL2vDOsmultE1Z1XlnD3oakB7djuDUSRnqXO-9HOPm8auqMTX4n2WA-J5D1mQpmS9MlOsvhAH4vAXhsYDiUE Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:21:48.128410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_989ba04f05174be39ebe58ac1cc813c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 208f96e06fcd496bb1b08dbe2ca77cb4 Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Snapshot 01707cbe-05b0-405d-b529-06ed9769d0e7 could not be found. Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '01707cbe-05b0-405d-b529-06ed9769d0e7'} Jul 12 16:21:48.129540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 01707cbe-05b0-405d-b529-06ed9769d0e7 could not be found. (HTTP 404) (Request-ID: req-2c02fda5-a549-415b-adac-0792228a684d) Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:48.130200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:48.131060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 01707cbe-05b0-405d-b529-06ed9769d0e7 could not be found. Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 16:21:48.131939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 01707cbe-05b0-405d-b529-06ed9769d0e7 could not be found. Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 01707cbe-05b0-405d-b529-06ed9769d0e7 could not be found. Jul 12 16:21:48.133035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:48.135925 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3d411ca8-3e87-451a-9cca-03685f452aed tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Returning 404 to user: Snapshot 01707cbe-05b0-405d-b529-06ed9769d0e7 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:21:48.136834 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3d411ca8-3e87-451a-9cca-03685f452aed tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7" status: 404 len: 111 microversion: 2.1 time: 0.063601 Jul 12 16:21:48.137972 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 11/20] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:21:48 2022] GET /compute/v2.1/os-snapshots/01707cbe-05b0-405d-b529-06ed9769d0e7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:21:48.149942 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c41047ca-a09e-432f-97b0-8f55546e8f03 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da780d790>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:48.306594 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c41047ca-a09e-432f-97b0-8f55546e8f03 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e" status: 202 len: 0 microversion: 2.1 time: 0.161598 Jul 12 16:21:48.309747 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 10/21] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:21:48 2022] DELETE /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:21:48.336165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4aa8fdbe-7f5b-4819-b519-003b6e754b6a tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da77908b0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:48.448546 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4aa8fdbe-7f5b-4819-b519-003b6e754b6a tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e" status: 200 len: 345 microversion: 2.1 time: 0.133631 Jul 12 16:21:48.449124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 12/22] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:48 2022] GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:49.473187 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a2712319-3159-4190-a5fe-b8291256ace5 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da780ddc0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:49.554087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-a2712319-3159-4190-a5fe-b8291256ace5 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] HTTP exception thrown: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a2712319-3159-4190-a5fe-b8291256ace5 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Request method failure captured: Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e HTTP/1.1 Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-Sk0oA78wfjJqiAUMqeE8PhiFmV6PZlQZ2dKgj1wjMdkFa0hH9gL40OLTD8TvQX-cKt5DilEKL6yjcfCVqSNqNPxWsL2vDOsmultE1Z1XlnD3oakB7djuDUSRnqXO-9HOPm8auqMTX4n2WA-J5D1mQpmS9MlOsvhAH4vAXhsYDiUE Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:21:49.559809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_989ba04f05174be39ebe58ac1cc813c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 208f96e06fcd496bb1b08dbe2ca77cb4 Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'f66a35b7-14a0-436d-adb4-25948c2f000e'} Jul 12 16:21:49.561562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. (HTTP 404) (Request-ID: req-1f3115f8-08d2-4ae5-ae79-ef2e4d349abd) Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.562191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:49.563039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 16:21:49.563920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a2712319-3159-4190-a5fe-b8291256ace5 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Returning 404 to user: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:21:49.564755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a2712319-3159-4190-a5fe-b8291256ace5 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e" status: 404 len: 109 microversion: 2.1 time: 0.105382 Jul 12 16:21:49.570489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:49 2022] GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:21:49.582570 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7c98e17b-a403-4528-99ad-d08bf53aa690 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da7825820>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:49.644317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-7c98e17b-a403-4528-99ad-d08bf53aa690 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] HTTP exception thrown: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7c98e17b-a403-4528-99ad-d08bf53aa690 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Request method failure captured: Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e HTTP/1.1 Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-Sk0oA78wfjJqiAUMqeE8PhiFmV6PZlQZ2dKgj1wjMdkFa0hH9gL40OLTD8TvQX-cKt5DilEKL6yjcfCVqSNqNPxWsL2vDOsmultE1Z1XlnD3oakB7djuDUSRnqXO-9HOPm8auqMTX4n2WA-J5D1mQpmS9MlOsvhAH4vAXhsYDiUE Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:21:49.647063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_989ba04f05174be39ebe58ac1cc813c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 208f96e06fcd496bb1b08dbe2ca77cb4 Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'f66a35b7-14a0-436d-adb4-25948c2f000e'} Jul 12 16:21:49.648176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. (HTTP 404) (Request-ID: req-f05804b5-74c2-4b4c-be07-99049a8681aa) Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.648781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 16:21:49.649752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 16:21:49.650639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7c98e17b-a403-4528-99ad-d08bf53aa690 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Returning 404 to user: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7c98e17b-a403-4528-99ad-d08bf53aa690 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e" status: 404 len: 109 microversion: 2.1 time: 0.071070 Jul 12 16:21:49.651487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:21:49 2022] DELETE /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:21:49.662349 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a0c17f6-e8ea-408e-be22-0cc48d486441 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Calling method '.version_select at 0x7f1da7824af0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:21:49.912212 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-5a0c17f6-e8ea-408e-be22-0cc48d486441 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] HTTP exception thrown: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a0c17f6-e8ea-408e-be22-0cc48d486441 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Request method failure captured: Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e HTTP/1.1 Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-Sk0oA78wfjJqiAUMqeE8PhiFmV6PZlQZ2dKgj1wjMdkFa0hH9gL40OLTD8TvQX-cKt5DilEKL6yjcfCVqSNqNPxWsL2vDOsmultE1Z1XlnD3oakB7djuDUSRnqXO-9HOPm8auqMTX4n2WA-J5D1mQpmS9MlOsvhAH4vAXhsYDiUE Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:21:49.915015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/989ba04f05174be39ebe58ac1cc813c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_989ba04f05174be39ebe58ac1cc813c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 989ba04f05174be39ebe58ac1cc813c1 Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1702281813 Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 208f96e06fcd496bb1b08dbe2ca77cb4 Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1702281813-project Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'f66a35b7-14a0-436d-adb4-25948c2f000e'} Jul 12 16:21:49.916306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. (HTTP 404) (Request-ID: req-17e43f50-daac-4a22-9af7-7f73592f7129) Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.917115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:21:49.918234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 16:21:49.920716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. Jul 12 16:21:49.921826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:21:49.923385 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a0c17f6-e8ea-408e-be22-0cc48d486441 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] Returning 404 to user: Volume f66a35b7-14a0-436d-adb4-25948c2f000e could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:21:49.924654 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5a0c17f6-e8ea-408e-be22-0cc48d486441 tempest-VolumesSnapshotsTestJSON-1702281813 tempest-VolumesSnapshotsTestJSON-1702281813-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e" status: 404 len: 109 microversion: 2.1 time: 0.270349 Jul 12 16:21:49.925541 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:21:49 2022] GET /compute/v2.1/os-volumes/f66a35b7-14a0-436d-adb4-25948c2f000e => generated 109 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:21:56.534442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-999af33b-c2cf-4d1a-aa17-3a2ad013c6a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'create', calling method: .version_select at 0x7f1da7790310>, body: {"keypair": {"name": "tempest-keypair-1612418878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSsQMp5rgkVCCTBby5GVYKbJd/P8sDXprf7QO1avHQwLkHOmYn2eA3Xblsqi7qc42vIDBjz6rqIW3aw+wcwE14dEh97b1X4+XU8XbnpmPGPITSy3YIb2VCKnYuExfNLHg=="}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:21:56.629101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-999af33b-c2cf-4d1a-aa17-3a2ad013c6a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for project 77ed8271e0d44de688f86520aa923c60. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:21:56.647512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-999af33b-c2cf-4d1a-aa17-3a2ad013c6a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for user e718e7f4f8974ff59151b87aef603a09 and project 77ed8271e0d44de688f86520aa923c60. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:21:56.738221 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-999af33b-c2cf-4d1a-aa17-3a2ad013c6a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.529778 Jul 12 16:21:56.738826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 14/26] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jul 12 16:21:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 531 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 16:21:57.714861 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d6b8ea1c-eb5d-444f-b2cf-7c737d59503f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: .version_select at 0x7f1da77575e0>, body: {"keypair": {"name": "tempest-keypair-1297231987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtvtE1yg0TaT82v7iRZbfH8ksXbfhO0P1+CiL+2iMGOdWOG2NIaRSis2xrrRVA8FElUqFgFEqYiY92gjo7Wxwmn0VeeoGaTDThZDKSIJwlcmk+7wpfoItX+jk2k3SBkQQ=="}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:21:57.784660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-d6b8ea1c-eb5d-444f-b2cf-7c737d59503f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:21:57.803388 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-d6b8ea1c-eb5d-444f-b2cf-7c737d59503f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:21:57.875543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d6b8ea1c-eb5d-444f-b2cf-7c737d59503f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.751578 Jul 12 16:21:57.876149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 15/27] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:21:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:21:57.881643 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-616801616", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "networks": [{"uuid": "0a240910-8529-4e45-9e26-2dddd95324f5"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:21:58.078227 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] validate_networks() for [('0a240910-8529-4e45-9e26-2dddd95324f5', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:21:59.295945 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1587807163", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:21:59.557730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] validate_networks() for [('87e78132-cbcf-464c-bc4d-d37d3116174a', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:22:00.603785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:22:00.604390 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:22:00.604826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:22:00.605559 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:22:00.606215 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:22:00.634241 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:00.635605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:00.636644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:00.639528 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:00.711608 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Getting quotas for project 8f025a4155ef47b69781bca71bc74c49. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:22:00.721255 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Getting quotas for user 3250ed88945641af86eb5b17c1917536 and project 8f025a4155ef47b69781bca71bc74c49. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:22:00.736534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:22:00.744061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:22:00.902689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1bf5d80c-346d-41c7-acab-1f91d8af83bd tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.054995 Jul 12 16:22:00.903587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 13/28] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:21:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:22:00.918820 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a802b076-20ad-42a0-8b9c-b7f04ec597d3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:00.920230 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a802b076-20ad-42a0-8b9c-b7f04ec597d3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:01.274081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a802b076-20ad-42a0-8b9c-b7f04ec597d3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:01.299535 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a802b076-20ad-42a0-8b9c-b7f04ec597d3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1214 microversion: 2.1 time: 0.384771 Jul 12 16:22:01.308036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 14/29] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:00 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1214 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:02.323178 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dfda76b5-46a5-4565-bdd3-4944497ce79a tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:02.323825 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dfda76b5-46a5-4565-bdd3-4944497ce79a tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:02.623351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dfda76b5-46a5-4565-bdd3-4944497ce79a tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:02.630376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dfda76b5-46a5-4565-bdd3-4944497ce79a tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1214 microversion: 2.1 time: 0.313709 Jul 12 16:22:02.645445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:02 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:02.949684 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:22:02.951382 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:22:02.952016 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:22:02.952579 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:22:02.953196 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:22:02.975103 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:02.975904 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:02.976917 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:02.977596 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:03.025238 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:22:03.030879 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for user e980def45e934114a2f0bc7081ffe8e3 and project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:22:03.057204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:22:03.068338 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:22:03.186937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6ca91f0a-5379-4862-a987-62416f69f02f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.108042 Jul 12 16:22:03.187591 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 16/31] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:21:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 4109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:22:03.188574 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2018076212", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9219161c-1505-4bdd-bd5a-586550da37d0"}], "security_groups": [{"name": "tempest-securitygroup--224921857"}], "key_name": "tempest-keypair-1612418878", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:03.199045 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f77ee433-3b54-4d0f-8eda-da5beaf21548 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:03.199675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f77ee433-3b54-4d0f-8eda-da5beaf21548 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:03.406010 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f77ee433-3b54-4d0f-8eda-da5beaf21548 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:03.442072 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f77ee433-3b54-4d0f-8eda-da5beaf21548 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1222 microversion: 2.1 time: 0.247865 Jul 12 16:22:03.443188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 17/32] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:03 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1222 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:03.650974 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:03.651588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:03.660703 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:03.663666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:03.664519 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:03.671969 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:03.772603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] validate_networks() for [('9219161c-1505-4bdd-bd5a-586550da37d0', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:22:03.993112 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:04.026660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-98f49b04-0c51-423d-881c-6e890c6fbb90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1218 microversion: 2.1 time: 0.379909 Jul 12 16:22:04.038435 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:03 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1218 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:04.045992 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1645415371", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:04.127585 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] validate_networks() for [('87e78132-cbcf-464c-bc4d-d37d3116174a', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:22:05.043660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:22:05.045505 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:22:05.046137 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:22:05.046958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:22:05.047761 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:22:05.062993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:05.063666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:05.064828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:05.065519 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:05.098184 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:22:05.119929 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for user e980def45e934114a2f0bc7081ffe8e3 and project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:22:05.150628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:22:05.160018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:22:05.313136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-bb415747-d6de-4ffb-a69d-1f6b3c9a3423 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.273092 Jul 12 16:22:05.313783 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 19/34] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:22:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:22:05.345554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:05.351644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:05.366097 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:05.366644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:05.367433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:05.367890 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:05.500477 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:05.508843 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7b8f17b2-29e1-4e60-8b9e-719fc02b55bc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1266 microversion: 2.1 time: 0.168958 Jul 12 16:22:05.509946 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 20/35] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:05 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:05.515093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6a6e80c2-0c1b-47d2-b439-3d3fc3116e4f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:05.516070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6a6e80c2-0c1b-47d2-b439-3d3fc3116e4f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:05.555397 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:22:05.555935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:22:05.556420 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:22:05.557089 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:22:05.557678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:22:05.578668 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:05.579176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:05.580168 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:05.580476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:05.609818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6a6e80c2-0c1b-47d2-b439-3d3fc3116e4f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:05.617746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6a6e80c2-0c1b-47d2-b439-3d3fc3116e4f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1222 microversion: 2.1 time: 0.106643 Jul 12 16:22:05.619925 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 21/36] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:05 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:05.628091 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1326495988", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39"}], "security_groups": [{"name": "tempest-securitygroup--1087535893"}], "key_name": "tempest-keypair-1297231987", "user_data": "}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:05.645396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for project 77ed8271e0d44de688f86520aa923c60. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:22:05.677452 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for user e718e7f4f8974ff59151b87aef603a09 and project 77ed8271e0d44de688f86520aa923c60. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:22:05.726459 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:22:05.741007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:22:05.923260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-340776fb-1e25-4693-ac35-584f5cba5c10 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.740681 Jul 12 16:22:05.925548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 16/37] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jul 12 16:22:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 16:22:05.944581 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-534adfc9-071d-451b-afcb-f54e15bea9ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:05.949734 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-534adfc9-071d-451b-afcb-f54e15bea9ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:06.000542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] validate_networks() for [('791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:22:06.144265 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-534adfc9-071d-451b-afcb-f54e15bea9ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:06.158487 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-534adfc9-071d-451b-afcb-f54e15bea9ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:06.170354 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-534adfc9-071d-451b-afcb-f54e15bea9ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:06.174443 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-534adfc9-071d-451b-afcb-f54e15bea9ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1282 microversion: 2.20 time: 0.239311 Jul 12 16:22:06.183958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 17/38] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:05 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1282 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:06.529982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:06.530888 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:06.542478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:06.543091 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:06.546389 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:06.548282 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:06.904752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:06.932315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-54f32427-f8b3-460d-9615-befbe20227b0 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1284 microversion: 2.1 time: 0.410046 Jul 12 16:22:06.940928 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 18/39] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:06 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1284 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:06.971888 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:06.979302 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:07.018664 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.019272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:07.022264 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.024261 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:07.156524 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:22:07.161736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:22:07.162393 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:22:07.163115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:22:07.163696 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:22:07.186822 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.193127 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:07.193959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.194409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:07.245455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:22:07.260126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:22:07.279175 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:07.287642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:22:07.293019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:22:07.298857 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6b3fce69-17c1-4b73-8f01-a40d51cea434 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1218 microversion: 2.1 time: 0.356691 Jul 12 16:22:07.305353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:06 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1218 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:07.318980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:07.332752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:07.353596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.360159 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:07.366828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.376726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:07.413695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4b8040ac-001d-46af-9430-659c0576fdb3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.791812 Jul 12 16:22:07.416596 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 22/41] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:22:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:22:07.445930 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e90b34de-4f9c-49bf-84fc-bdd802e59709 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:07.446562 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e90b34de-4f9c-49bf-84fc-bdd802e59709 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:07.585202 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e90b34de-4f9c-49bf-84fc-bdd802e59709 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:07.594809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e90b34de-4f9c-49bf-84fc-bdd802e59709 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1242 microversion: 2.1 time: 0.165817 Jul 12 16:22:07.595862 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:07 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1242 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:07.601549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:07.634138 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:07.636088 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:07.637402 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c7ea58d5-da00-4461-ae15-c37340332b64 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1286 microversion: 2.20 time: 0.330848 Jul 12 16:22:07.644975 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 20/43] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:07 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1286 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:07.956089 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:07.956626 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:07.967168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.967615 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:07.968402 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:07.968856 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:08.107942 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:08.118690 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-13f94421-e41f-421e-8e81-f395ff7b834e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1272 microversion: 2.1 time: 0.167007 Jul 12 16:22:08.120438 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:07 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:08.316375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:08.323225 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:08.351149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:08.351607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:08.352389 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:08.352829 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:08.612775 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:08.614051 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:08.625321 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:08.625778 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:08.626559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:08.627003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:08.680398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:08.698339 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-90533c3e-71e3-4957-bd20-c6751bafd9a3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1282 microversion: 2.1 time: 0.385756 Jul 12 16:22:08.699554 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 21/45] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:08 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1282 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:08.712504 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:08.713424 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:08.726335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:08.727050 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:08.729258 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:08.730556 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:08.974757 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:08.987698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-88b092ff-285c-4379-9581-3835d61bf4aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1238 microversion: 2.1 time: 0.378650 Jul 12 16:22:08.994669 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 25/46] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:08 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1238 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:09.084668 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:09.100212 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:09.104202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:09.116297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-10ef87bd-dfcf-440b-8466-17d4e91f7432 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1342 microversion: 2.20 time: 0.415445 Jul 12 16:22:09.119316 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 22/47] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:08 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1342 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:09.139222 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:09.140031 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:09.162129 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:09.162129 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:09.162373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:09.164357 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:09.717484 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:09.718294 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:09.734120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:09.734574 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:09.746023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:09.756097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:09.877225 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:09.885780 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-00032af6-f72c-41e6-bb1e-3798c95cde58 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1272 microversion: 2.1 time: 0.751811 Jul 12 16:22:09.895054 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:09 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1272 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:10.018086 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:10.021038 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:10.039923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:10.050302 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:10.058395 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:10.058901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:10.424611 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:10.433161 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6bed59a5-bcfd-4dd5-aed3-63b091917351 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1312 microversion: 2.1 time: 0.424858 Jul 12 16:22:10.435959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 27/49] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:10 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1312 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:10.457242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:10.459419 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:10.462735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:10.463892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:10.482224 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f0df6c4c-483b-4c10-b144-282cf897e27c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1280 microversion: 2.1 time: 0.760652 Jul 12 16:22:10.488880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:10.489376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 23/50] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:09 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1280 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:10.489994 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:10.491166 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:10.491613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:10.830731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:10.842228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:10.850827 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:10.871669 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7d1103ee-3307-4b52-9046-66fca42c5374 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1340 microversion: 2.20 time: 0.426110 Jul 12 16:22:10.872283 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 28/51] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:10 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1340 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:10.914232 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:10.914969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:10.937111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:10.937764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:10.941636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:10.942149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:11.454021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:11.457162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:11.483666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:11.484435 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:11.486661 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:11.496688 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:11.533796 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:11.553458 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4894ea95-447b-4fc8-9c11-bca2b31f7032 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.642435 Jul 12 16:22:11.581258 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 24/52] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:10 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:11.601119 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:11.609845 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:11.642048 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:11.642532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:11.654830 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:11.655405 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:11.909976 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:11.939386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f3baa9c6-91ba-4f4c-a979-8c59d67f61cf tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1300 microversion: 2.1 time: 0.481704 Jul 12 16:22:11.942265 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 29/53] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:11 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1300 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:11.950707 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:11.963413 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fefe7d16-1803-4b22-8512-058c3f23a682 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1280 microversion: 2.1 time: 0.378540 Jul 12 16:22:11.964332 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 25/54] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:11 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1280 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:11.966868 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:11.973566 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:11.988319 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:11.989136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:11.996055 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:11.997983 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:12.175977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:12.192677 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:12.196942 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:12.201470 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2fea1bbd-6c22-47a4-a59d-cafca83df686 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1340 microversion: 2.20 time: 0.252280 Jul 12 16:22:12.221404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 30/55] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:11 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1340 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:12.572659 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:12.573342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:12.586900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:12.587335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:12.590909 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:12.592749 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:12.960303 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:12.961209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:12.986162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:12.986923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:12.988633 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:12.993819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:13.292997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:13.310432 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0926c28f-6cb8-45d9-b1a3-d27db4d3a227 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1300 microversion: 2.1 time: 0.353343 Jul 12 16:22:13.312332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 31/56] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:12 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1300 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:13.333331 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:13.334226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:13.347562 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:13.354034 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:13.355364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:13.356169 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:13.416682 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:13.439038 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fb1862e7-d996-4c86-8d98-3c51b1cfdf8d tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.871129 Jul 12 16:22:13.441828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 26/57] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:12 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:13.454924 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:13.456100 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:13.466580 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:13.467967 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:13.470398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:13.471489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:13.910965 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:13.923730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9683d76c-87f1-4ca1-aaae-a01493d93214 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1280 microversion: 2.1 time: 0.607563 Jul 12 16:22:13.947642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 32/58] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:13 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1280 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:14.337730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:14.338494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:14.363755 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:14.364200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:14.364983 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:14.365700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:15.202225 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:15.213589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a3f1e297-678c-4265-b507-a93218193d5c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.882694 Jul 12 16:22:15.216307 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 33/59] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:14 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:15.228612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:15.232743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:15.249142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:15.253856 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:15.254887 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:15.255463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:15.453728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:15.470488 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:15.475747 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:15.479715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-98051109-f5ab-4e9d-8c2d-6bc1e58bd98e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 2.035503 Jul 12 16:22:15.482323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 27/60] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:13 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:15.494940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:15.495996 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:15.516113 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:15.517344 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:15.519864 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:15.520639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:15.610417 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:16.152605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=18 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:16.245495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:16.269218 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-40121c92-7406-4923-bb08-46f28c884d07 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 1.048666 Jul 12 16:22:16.271130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 34/61] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:15 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:16.297221 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:16.300194 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:16.348321 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:16.349172 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:16.352930 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:16.358281 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:16.531404 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:16.541945 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-709dff5d-f49e-4147-bb3e-a5da961fdb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 1.058280 Jul 12 16:22:16.544673 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 28/62] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:15 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:16.566463 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:16.568790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:16.594902 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:16.595759 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:16.601882 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:16.602617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:17.226796 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=6 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:17.459227 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:17.469803 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6ed89409-1523-457b-8716-59f01f8f3611 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 1.196064 Jul 12 16:22:17.474056 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 35/63] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:16 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:17.486082 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:17.487030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:17.501133 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:17.501686 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:17.502545 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:17.503032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:17.590241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=32 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:17.668146 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:17.686228 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:17.688844 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:17.691606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-637c965f-a6a6-4eed-8bac-9dd8f894aa72 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 1.145183 Jul 12 16:22:17.704230 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 29/64] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:16 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:17.704230 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:17.704230 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:17.741428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:17.742470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:17.744946 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:17.746072 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:18.023353 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:18.044342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5a9a4a0e-596c-47ed-b7fc-3fe631b7f4d7 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.568303 Jul 12 16:22:18.046118 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 36/65] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:17 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:18.495896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:18.496631 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:18.518999 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:18.519787 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:18.520763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:18.533182 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:18.587232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:19.092361 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:19.101281 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6c713c23-0f8d-4f39-8b39-b224ae6fb901 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 1.405327 Jul 12 16:22:19.107913 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 30/66] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:17 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:19.127469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:19.128371 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:19.151862 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:19.153637 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:19.166079 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:19.166926 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:19.733461 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:19.745398 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-880f8968-2eb0-4070-91ce-3daad16d80b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 1.258715 Jul 12 16:22:19.747102 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 37/67] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:18 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:19.752962 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:19.754405 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:19.763638 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:19.764682 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:19.766750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:19.767570 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:20.826440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:20.835878 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-327ea3a9-e9e3-47a4-8049-540247147280 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 1.087512 Jul 12 16:22:20.844156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:20.847310 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 38/68] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:19 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:20.853352 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:20.871972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:20.880033 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-620ad998-9659-41af-a95e-da5d16e05e53 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 1.769942 Jul 12 16:22:20.880713 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 31/69] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:19 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:20.899134 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:20.899554 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:20.910907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:20.920164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:20.920606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:20.924660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:20.928356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.307727 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-24c0dd1a-d238-4675-afc9-c201949caf95 req-f0073fea-b79a-4bdb-af64-cedb1ea494bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b", "tag": "ee938d9d-4c97-4e36-891d-386db9564d75"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:21.345720 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-24c0dd1a-d238-4675-afc9-c201949caf95 req-f0073fea-b79a-4bdb-af64-cedb1ea494bb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.346165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-24c0dd1a-d238-4675-afc9-c201949caf95 req-f0073fea-b79a-4bdb-af64-cedb1ea494bb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.395402 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-24c0dd1a-d238-4675-afc9-c201949caf95 req-f0073fea-b79a-4bdb-af64-cedb1ea494bb service nova] Creating event network-changed:ee938d9d-4c97-4e36-891d-386db9564d75 for instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b on hv-cinder-79760 Jul 12 16:22:21.395948 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-24c0dd1a-d238-4675-afc9-c201949caf95 req-f0073fea-b79a-4bdb-af64-cedb1ea494bb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 16:22:21.397110 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57a0183f-0512-45f4-bd0f-223d839c0fef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.397551 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57a0183f-0512-45f4-bd0f-223d839c0fef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.398327 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57a0183f-0512-45f4-bd0f-223d839c0fef None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.398751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57a0183f-0512-45f4-bd0f-223d839c0fef None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.421390 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.compute.rpcapi [None req-57a0183f-0512-45f4-bd0f-223d839c0fef None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 16:22:21.422728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57a0183f-0512-45f4-bd0f-223d839c0fef None None] Releasing lock "compute-rpcapi-router" {{(pid=117791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 16:22:21.456560 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-57a0183f-0512-45f4-bd0f-223d839c0fef None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.607775 Jul 12 16:22:21.457584 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 39/70] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:21.589737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:21.601536 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ec1ebcc8-f159-4f85-aec2-9443499dd539 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.719750 Jul 12 16:22:21.602784 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 32/71] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:20 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:21.608496 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:21.609205 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:21.616523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.617474 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.618567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.619235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.652281 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-3731ffc0-0a10-4ce6-bd40-813d5ef753ca req-1a74da59-2796-4fd1-99c7-fd2c272154a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8b44ee-7b55-4959-ae86-6ab7c888a36f", "tag": "1f91d14b-ab01-4c87-89c1-746a8fecfb93"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:21.662674 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-3731ffc0-0a10-4ce6-bd40-813d5ef753ca req-1a74da59-2796-4fd1-99c7-fd2c272154a1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.663222 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-3731ffc0-0a10-4ce6-bd40-813d5ef753ca req-1a74da59-2796-4fd1-99c7-fd2c272154a1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.676722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-3731ffc0-0a10-4ce6-bd40-813d5ef753ca req-1a74da59-2796-4fd1-99c7-fd2c272154a1 service nova] Creating event network-changed:1f91d14b-ab01-4c87-89c1-746a8fecfb93 for instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f on hv-cinder-79760 Jul 12 16:22:21.683445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-3731ffc0-0a10-4ce6-bd40-813d5ef753ca req-1a74da59-2796-4fd1-99c7-fd2c272154a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224424 Jul 12 16:22:21.685253 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 40/72] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:21.861982 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:21.864131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:21.875984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.876950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:21.877997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:21.879488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:22.006295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:22.010449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:22.016883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2651d63d-fd1c-4549-8b06-f520093f4842 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.412639 Jul 12 16:22:22.017629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 33/73] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:21 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:22.027798 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:22.028762 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:22.035700 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:22.036218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:22.037146 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:22.037671 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:22.175934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:22.188621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-94fd0fa5-a8f8-423d-8aa8-07dc95e9ec29 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.334549 Jul 12 16:22:22.188621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 41/74] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:21 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:22.255522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:22.269085 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:22.272186 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:22.273733 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-48023bdb-b4a9-4745-9e11-56c16278bf1a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.254883 Jul 12 16:22:22.274908 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 34/75] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:22 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:22.619468 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:22.620085 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:22.626641 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:22.627623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:22.628427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:22.628896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:22.770978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:22.778420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-dd019c28-e854-4aab-a432-e71c51109d6b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.163501 Jul 12 16:22:22.779603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 42/76] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:22 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:23.035223 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:23.036120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:23.042433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.043080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.044734 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.045807 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.196842 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:23.205754 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e4330493-e1ac-433e-869d-70fb4e20dabc tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.175388 Jul 12 16:22:23.205908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:23.206407 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:23.207492 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 35/77] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:23 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:23.214846 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.216171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.217699 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.218350 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.294305 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:23.294914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:23.302336 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.303151 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.303969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.304915 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.377175 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:23.385218 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f5452be2-e89e-4ded-9754-dbc3fe214d96 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.183991 Jul 12 16:22:23.386083 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 43/78] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:23 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:23.452410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:23.461351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:23.462865 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:23.464110 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9018f7a1-7935-48f7-bdd8-dd837d89da16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.173946 Jul 12 16:22:23.464659 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 36/79] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:23 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:23.646124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-7a776103-4842-4344-89d5-0f28f2be46a7 req-9337e03b-e326-4415-922b-860b23081ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b", "tag": "bb8c098f-fbb4-46b3-abf2-a2248399930d"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:23.655790 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-7a776103-4842-4344-89d5-0f28f2be46a7 req-9337e03b-e326-4415-922b-860b23081ca1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.656315 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-7a776103-4842-4344-89d5-0f28f2be46a7 req-9337e03b-e326-4415-922b-860b23081ca1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.674727 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-7a776103-4842-4344-89d5-0f28f2be46a7 req-9337e03b-e326-4415-922b-860b23081ca1 service nova] Creating event network-changed:bb8c098f-fbb4-46b3-abf2-a2248399930d for instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b on hv-cinder-79760 Jul 12 16:22:23.680373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-7a776103-4842-4344-89d5-0f28f2be46a7 req-9337e03b-e326-4415-922b-860b23081ca1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037809 Jul 12 16:22:23.680906 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 44/80] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:23.742505 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-73473c53-d2e6-4be0-9d4e-38e3789e9e5d req-47dbccb4-630a-4943-a2e7-5dcc8b95d47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97836b86-898a-44df-a529-4ebf4089cdbd", "tag": "e68e6123-a7c0-4686-82ee-e2ff130f0da3"}, {"name": "network-changed", "server_uuid": "c6459fa8-bfbc-40a1-af27-2d44bad65d98", "tag": "2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:23.756327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-73473c53-d2e6-4be0-9d4e-38e3789e9e5d req-47dbccb4-630a-4943-a2e7-5dcc8b95d47d service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.757032 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-73473c53-d2e6-4be0-9d4e-38e3789e9e5d req-47dbccb4-630a-4943-a2e7-5dcc8b95d47d service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.781545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-73473c53-d2e6-4be0-9d4e-38e3789e9e5d req-47dbccb4-630a-4943-a2e7-5dcc8b95d47d service nova] Creating event network-changed:e68e6123-a7c0-4686-82ee-e2ff130f0da3 for instance 97836b86-898a-44df-a529-4ebf4089cdbd on hv-cinder-79760 Jul 12 16:22:23.782557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-73473c53-d2e6-4be0-9d4e-38e3789e9e5d req-47dbccb4-630a-4943-a2e7-5dcc8b95d47d service nova] Creating event network-changed:2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4 for instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 on hv-cinder-79760 Jul 12 16:22:23.783379 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-73473c53-d2e6-4be0-9d4e-38e3789e9e5d req-47dbccb4-630a-4943-a2e7-5dcc8b95d47d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117792) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 16:22:23.784885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54432d0c-0d56-45a4-b207-b1f0de46a7c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.785464 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54432d0c-0d56-45a4-b207-b1f0de46a7c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.786486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54432d0c-0d56-45a4-b207-b1f0de46a7c8 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.787247 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54432d0c-0d56-45a4-b207-b1f0de46a7c8 None None] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.797165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:23.798037 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:23.801217 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.compute.rpcapi [None req-54432d0c-0d56-45a4-b207-b1f0de46a7c8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 16:22:23.802560 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54432d0c-0d56-45a4-b207-b1f0de46a7c8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117792) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 16:22:23.808826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.809888 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.812220 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:23.813015 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:23.835294 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-54432d0c-0d56-45a4-b207-b1f0de46a7c8 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096605 Jul 12 16:22:23.836006 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 37/81] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:22:24.012339 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:24.021883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-83e913ec-fca6-45d2-bed8-239cafbcb776 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.228969 Jul 12 16:22:24.023053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 45/82] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:23 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:24.224321 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:24.225029 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:24.232397 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:24.232864 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:24.235040 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:24.235640 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:24.402709 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:24.403850 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:24.410370 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:24.424995 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:24.424995 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:24.425391 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fdffc95e-e457-4391-9a21-29117a8f0630 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.198133 Jul 12 16:22:24.425575 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:24.425575 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:24.425734 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 38/83] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:24 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:24.483729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:24.484608 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:24.491268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:24.491942 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:24.493167 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:24.493752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:24.597832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:24.614004 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d804e174-0b29-4336-a967-63d3ce7b9bc9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.212161 Jul 12 16:22:24.614004 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 46/84] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:24 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:24.649297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:24.657598 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:24.659112 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:24.660267 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fa7b92cc-3ea2-407f-b568-64f4437ddb80 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.181893 Jul 12 16:22:24.660963 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 39/85] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:24 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:22:25.039405 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:25.040034 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:25.046575 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.047214 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.048146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.048850 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.315477 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:25.323407 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0df90eb7-be71-4a4a-bbc4-8c1fe75cb18a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.288600 Jul 12 16:22:25.323989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 47/86] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:25 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:25.441672 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:25.442501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:25.449476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.450606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.451455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.451928 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.635427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:25.636824 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:25.651842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.657938 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.658778 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.659392 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.859051 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:25.875763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d248c7e8-0fa5-4833-8545-81bfa0fe7836 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.442215 Jul 12 16:22:25.880774 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 40/87] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:25 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:25.892736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:25.895034 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:25.913935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.914470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.917671 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:25.919862 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:25.949748 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:25.961795 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b2610d83-248e-43ec-ae0c-4cb9dfbd6df3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.332100 Jul 12 16:22:25.963328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 48/88] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:25 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:26.341300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:26.342027 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:26.354912 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:26.355362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:26.356655 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:26.357502 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:26.515113 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:26.524062 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:26.526203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:26.527939 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8d3a9307-7a6a-49ee-83e9-809a0953e0d4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.645921 Jul 12 16:22:26.528963 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 41/89] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:25 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:26.636180 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:26.644376 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-16890f83-fd30-4f59-ad56-5f2c158d7bbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.307246 Jul 12 16:22:26.645038 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 49/90] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:26 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:26.896776 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:26.897682 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:26.904783 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:26.905761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:26.906741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:26.907377 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:26.977866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:26.978580 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:26.985717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:26.986238 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:26.987207 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:26.987896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:27.080044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:27.089234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c5be0f3f-88e6-49ac-a952-df2f02cdcac1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.196430 Jul 12 16:22:27.089828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 42/91] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:26 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:27.145534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:27.153115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e1d1d8e5-1644-4247-bbec-955791b691ca tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.179193 Jul 12 16:22:27.153686 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 50/92] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:26 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:27.546570 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:27.547178 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:27.553658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:27.554112 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:27.554882 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:27.555321 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:27.661403 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:27.662789 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:27.669810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:27.670517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:27.671496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:27.672149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:27.700623 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:27.709116 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:27.711391 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:27.712327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-deb1fc27-e119-434b-aa64-68282175237e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.170089 Jul 12 16:22:27.723235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 43/93] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:27 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:27.856968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:27.864479 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-89102222-0164-4ec5-90a6-ea597841d07a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.206844 Jul 12 16:22:27.869731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 51/94] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:27 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:28.110848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:28.112021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:28.120730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.121201 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:28.122787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.123709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:28.170461 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:28.171086 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:28.178957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.179410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:28.180178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.180617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:28.315991 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:28.333785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6b3c7582-dc1b-43db-86d0-59505241e958 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.227108 Jul 12 16:22:28.334372 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 44/95] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:28 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:28.361731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:28.374089 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8fdc6ccd-1177-4017-b86c-e5fa2dc4e5c2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.207629 Jul 12 16:22:28.374743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 52/96] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:28 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:28.732993 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:28.733837 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:28.743119 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.743652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:28.744423 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.744863 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:28.882726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:28.883534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:28.895613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.896071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:28.896847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:28.897311 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:29.080899 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:29.095717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:29.098181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:29.106456 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-026a48ef-e4c3-4369-9d86-7b49eb196412 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.377863 Jul 12 16:22:29.109366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 45/97] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:28 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:29.162021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:29.176365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-97f6eecc-c8f8-4f05-ba78-2a76b31ad0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.297612 Jul 12 16:22:29.177103 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 53/98] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:28 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:29.349851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:29.350705 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:29.357611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:29.358269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:29.359106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:29.359557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:29.400074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:29.400074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:29.400074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:29.400074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:29.400411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:29.400411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:29.532033 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:29.544206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f072a6ea-588d-4f00-8092-c68777ceeb3e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.197825 Jul 12 16:22:29.545094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 46/99] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:29 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:29.568376 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:29.579127 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ab978386-2fd3-4e20-a074-e4be72a200f6 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.192169 Jul 12 16:22:29.580272 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 54/100] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:29 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:30.126444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:30.127647 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:30.139166 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.139669 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.140455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.140953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.194229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:30.195211 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:30.214498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.214949 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.216350 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.216783 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.333993 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:30.346116 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:30.347818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:30.351764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-900a76ff-d9ca-4018-8dbf-6d90c4c93c66 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.226347 Jul 12 16:22:30.360358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 47/101] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:30 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:30.567221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:30.568064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:30.575443 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.576181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.577498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.578089 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.641174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:30.645889 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:30.656255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9dc6f524-3dd0-4e87-b093-b4c910c55cb6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.465906 Jul 12 16:22:30.657348 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 55/102] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:30 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:30.673144 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:30.677412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:30.688692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.689139 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.689907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:30.690944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:30.811875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:30.820977 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cf62d61c-3d0b-4081-84f9-1150121bc39c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.260611 Jul 12 16:22:30.821826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 48/103] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:30 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:31.003235 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:31.012707 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-869e2d62-4adb-4f85-96e9-2ca5693b0622 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.353839 Jul 12 16:22:31.014476 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 56/104] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:30 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:31.372116 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:31.372752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:31.382357 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:31.383326 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:31.387365 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:31.389731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:31.419459 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:31.908888 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:31.925213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:31.927726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:31.933768 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-efafe506-209f-4e37-9f04-53dee620953f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.565757 Jul 12 16:22:31.939295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 49/105] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:31 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:31.956455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:31.958374 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:31.976425 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:31.978623 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:31.979793 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:31.982829 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:32.014938 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-cac7c393-df23-4f06-8cf8-93bb68bf51bc req-82a6c818-f257-4a62-9ce2-b2bd800897bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b", "name": "network-vif-plugged", "status": "completed", "tag": "ee938d9d-4c97-4e36-891d-386db9564d75"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:32.032042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-cac7c393-df23-4f06-8cf8-93bb68bf51bc req-82a6c818-f257-4a62-9ce2-b2bd800897bb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:32.032592 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-cac7c393-df23-4f06-8cf8-93bb68bf51bc req-82a6c818-f257-4a62-9ce2-b2bd800897bb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:32.058702 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-cac7c393-df23-4f06-8cf8-93bb68bf51bc req-82a6c818-f257-4a62-9ce2-b2bd800897bb service nova] Creating event network-vif-plugged:ee938d9d-4c97-4e36-891d-386db9564d75 for instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b on hv-cinder-79760 Jul 12 16:22:32.065788 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-cac7c393-df23-4f06-8cf8-93bb68bf51bc req-82a6c818-f257-4a62-9ce2-b2bd800897bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.693584 Jul 12 16:22:32.066833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 57/106] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:32.082036 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:32.083970 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:32.092637 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:32.094343 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:32.095147 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:32.095585 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:32.457356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:32.461470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:32.467746 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8d998545-96c7-4ed7-a691-91c228bda1bf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.516849 Jul 12 16:22:32.477861 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 50/107] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:31 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:32.483056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:32.483690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:32.491091 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:32.491544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:32.492320 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:32.492760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:32.623700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:32.634900 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e59ac685-12e2-488c-92ea-5a9dbe0e16b8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.559764 Jul 12 16:22:32.646063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 58/108] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:32 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:32.657978 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:32.666107 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7d5cc77f-c349-49b1-9b63-d3e4e8bed96c tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.187127 Jul 12 16:22:32.666949 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 51/109] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:32 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:32.959666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:32.960624 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:32.968011 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:32.969141 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:32.970243 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:32.970826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:33.135126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:33.147490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:33.149671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:33.150958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-873b8879-09a7-4d51-a31b-30d5532abfec tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.197517 Jul 12 16:22:33.151797 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 59/110] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:32 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:33.488436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:33.490508 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:33.506644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:33.508965 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:33.513885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:33.514436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:33.652571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:33.653797 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:33.669934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:33.670637 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:33.671616 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:33.672464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:33.797995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:34.027395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:34.038117 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c4662142-8111-4720-9104-75518663133c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.555357 Jul 12 16:22:34.040003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 52/111] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:33 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:34.049727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:34.050912 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:34.063024 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:34.063704 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:34.067713 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:34.090113 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:34.091469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:34.092953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-354394e6-e0f9-4eab-8014-c079e8157a88 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.431343 Jul 12 16:22:34.095664 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 60/112] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:33 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:34.109357 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-6bf3aece-fbab-40a0-a33f-7fe7f012ea2f req-a8ab3e92-22a7-4576-80ef-b4f98ec0e5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8b44ee-7b55-4959-ae86-6ab7c888a36f", "name": "network-vif-plugged", "status": "completed", "tag": "1f91d14b-ab01-4c87-89c1-746a8fecfb93"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:34.158669 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-6bf3aece-fbab-40a0-a33f-7fe7f012ea2f req-a8ab3e92-22a7-4576-80ef-b4f98ec0e5cb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:34.160387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-6bf3aece-fbab-40a0-a33f-7fe7f012ea2f req-a8ab3e92-22a7-4576-80ef-b4f98ec0e5cb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:34.190527 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-6bf3aece-fbab-40a0-a33f-7fe7f012ea2f req-a8ab3e92-22a7-4576-80ef-b4f98ec0e5cb service nova] Creating event network-vif-plugged:1f91d14b-ab01-4c87-89c1-746a8fecfb93 for instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f on hv-cinder-79760 Jul 12 16:22:34.200230 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-6bf3aece-fbab-40a0-a33f-7fe7f012ea2f req-a8ab3e92-22a7-4576-80ef-b4f98ec0e5cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100097 Jul 12 16:22:34.204670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 61/113] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:34.211714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:34.212582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:34.221961 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:34.222472 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:34.223434 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:34.223877 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:34.495207 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:34.507594 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-17cf4a67-6162-4a61-af4b-cf43cd4e5f72 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.464621 Jul 12 16:22:34.508726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 53/114] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:34 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:34.588663 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:34.597239 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:34.598758 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:34.601320 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5778d61a-ab4a-463d-b8b1-03f4355aa15c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.395029 Jul 12 16:22:34.602076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 62/115] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:34 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:35.055478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:35.056208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:35.064322 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.064961 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.065909 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.066418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.112293 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:35.113684 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:35.121164 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.122492 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.123596 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.124571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.264429 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:35.272316 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cdd4dff9-2ccf-4be4-bcef-ef92028be2f8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.220616 Jul 12 16:22:35.274777 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 54/116] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:35 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:35.288076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:35.295916 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e101856b-59ae-4a59-bb7c-ca1769e72a5f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.187788 Jul 12 16:22:35.296471 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 63/117] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:35 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:35.524434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:35.525098 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:35.530972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.531419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.532173 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.532603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.620780 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:35.621947 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:35.627966 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.628610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.629399 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:35.629827 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:35.682819 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:35.695115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ac9f67e5-88bb-4395-a6f2-83517a084dff tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.172611 Jul 12 16:22:35.696539 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 55/118] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:35 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:35.807663 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:35.816539 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:35.818769 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:35.819886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b8210fec-fab7-4d05-a6fc-bea322437003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.203568 Jul 12 16:22:35.820431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 64/119] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:35 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:22:36.291280 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:36.291821 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:36.298064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.298613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.299426 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.299859 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.312977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:36.314280 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:36.320883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.321569 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.322332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.323159 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.469042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:36.478426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-145f084b-6ecd-4377-85ad-12d722dfdf6f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.169589 Jul 12 16:22:36.479034 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 65/120] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:36 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:36.491312 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:36.499214 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2287a504-cb4d-420e-80ce-adda0f2a8248 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.212101 Jul 12 16:22:36.499772 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 56/121] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:36 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:36.712602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:36.713265 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:36.719196 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.719642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.720424 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.720853 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.837365 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:36.837980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:36.844012 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.844458 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.844554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:36.845254 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:36.845689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:36.852047 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2e04bd94-e25a-493b-a22b-85f1cca7051e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.143264 Jul 12 16:22:36.852644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 66/122] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:36 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:36.969466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:36.977239 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:36.978745 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:36.979841 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ce2c365c-acf6-4177-a9e3-a551067e94d6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.146403 Jul 12 16:22:36.980398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 57/123] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:36 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:37.495305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:37.495908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:37.501873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:37.502313 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:37.503055 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:37.503482 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:37.515988 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:37.516629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:37.522583 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:37.523034 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:37.523787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:37.524222 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:37.632624 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:37.640531 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-43c4a69a-f701-417e-a074-18075635ccc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.148992 Jul 12 16:22:37.641113 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 67/124] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:37 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:37.651745 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:37.659725 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-255b43f5-5c61-48d9-910b-f052b9e818f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.148127 Jul 12 16:22:37.660284 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 58/125] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:37 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:37.869345 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:37.869912 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:37.876500 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:37.876947 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:37.877747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:37.878198 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:37.999146 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:37.999992 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:38.007599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:38.008044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:38.008805 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:38.009261 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:38.015414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:38.024704 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-00fcbe55-e4da-4238-834d-ad7cde96ae98 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1314 microversion: 2.1 time: 0.159561 Jul 12 16:22:38.025592 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 68/126] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:37 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:38.142986 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:38.152447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:38.154130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:38.155327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-08bbf6f9-0d1a-439d-9efc-e85933a689b0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.160737 Jul 12 16:22:38.155992 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 59/127] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:37 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:22:38.290148 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-a1a3f0c2-7b65-4422-98cf-4e08be06535c req-3bb8e17c-ce2e-45f2-93a6-fca2c99bffca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97836b86-898a-44df-a529-4ebf4089cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "e68e6123-a7c0-4686-82ee-e2ff130f0da3"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:38.299773 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-a1a3f0c2-7b65-4422-98cf-4e08be06535c req-3bb8e17c-ce2e-45f2-93a6-fca2c99bffca service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:38.300560 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-a1a3f0c2-7b65-4422-98cf-4e08be06535c req-3bb8e17c-ce2e-45f2-93a6-fca2c99bffca service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:38.315197 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-a1a3f0c2-7b65-4422-98cf-4e08be06535c req-3bb8e17c-ce2e-45f2-93a6-fca2c99bffca service nova] Creating event network-vif-plugged:e68e6123-a7c0-4686-82ee-e2ff130f0da3 for instance 97836b86-898a-44df-a529-4ebf4089cdbd on hv-cinder-79760 Jul 12 16:22:38.322022 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-a1a3f0c2-7b65-4422-98cf-4e08be06535c req-3bb8e17c-ce2e-45f2-93a6-fca2c99bffca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035286 Jul 12 16:22:38.323918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 69/128] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:38.658321 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:38.658943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:38.664936 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:38.665427 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:38.666190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:38.666630 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:38.676168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:38.677454 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:38.684095 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:38.684350 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:38.685187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:38.685840 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:38.822878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:38.833887 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-21baaecc-cfb2-4028-ae1e-4003a6812d33 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.179130 Jul 12 16:22:38.834767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 60/129] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:38 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:38.901699 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:38.912032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b0b2edbc-f097-4981-852f-7622a07602ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.239895 Jul 12 16:22:38.922816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 70/130] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:38 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:39.042549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:39.046409 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:39.050801 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.051476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:39.052349 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.052816 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:39.175699 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:39.176515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:39.183284 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.184555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:39.186070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.186726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:39.212607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:39.221888 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-323eb6a8-b0aa-4e54-8937-b4ba93913111 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1501 microversion: 2.1 time: 0.184195 Jul 12 16:22:39.232953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 61/131] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:39 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:39.357910 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:39.368972 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:39.371127 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:39.373849 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b1f25c6a-d31b-4e6b-ba94-5b46c9721f49 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.203748 Jul 12 16:22:39.375396 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 71/132] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:39 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:22:39.851229 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:39.851840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:39.858000 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.858449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:39.859206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.859644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:39.929621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:39.930372 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:39.936714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.937191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:39.937949 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:39.938383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:40.008733 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:40.017695 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d4646abc-deb2-4196-95cf-3f6ac4388b71 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.170229 Jul 12 16:22:40.018264 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 62/133] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:39 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:40.076844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:40.084228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-71674ccb-6a3c-4cdd-88be-3a9e70d6c0ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.158506 Jul 12 16:22:40.084792 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 72/134] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:39 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:40.338169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-5d769cc2-9e4e-40a7-adda-d3e84666670a req-aa5fe4db-6e8e-402e-9b79-2643b53f1a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b", "name": "network-vif-plugged", "status": "completed", "tag": "bb8c098f-fbb4-46b3-abf2-a2248399930d"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:40.346271 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5d769cc2-9e4e-40a7-adda-d3e84666670a req-aa5fe4db-6e8e-402e-9b79-2643b53f1a19 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:40.346720 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5d769cc2-9e4e-40a7-adda-d3e84666670a req-aa5fe4db-6e8e-402e-9b79-2643b53f1a19 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:40.357270 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-5d769cc2-9e4e-40a7-adda-d3e84666670a req-aa5fe4db-6e8e-402e-9b79-2643b53f1a19 service nova] Creating event network-vif-plugged:bb8c098f-fbb4-46b3-abf2-a2248399930d for instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b on hv-cinder-79760 Jul 12 16:22:40.362101 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-5d769cc2-9e4e-40a7-adda-d3e84666670a req-aa5fe4db-6e8e-402e-9b79-2643b53f1a19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027616 Jul 12 16:22:40.362731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 63/135] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:22:40.392285 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:40.392898 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:40.399028 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:40.399483 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:40.400325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:40.400793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:40.529324 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:40.538650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:40.540178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:40.541556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-61bb43ed-94ae-42d0-a79e-3a9a10fa96ea tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.152978 Jul 12 16:22:40.542293 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 73/136] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:40 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:22:41.034971 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:41.035680 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:41.041926 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:41.042376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:41.043766 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:41.044204 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:41.100820 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:41.101625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:41.103697 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=91 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:41.110440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:41.111168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:41.112201 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:41.113092 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:41.132420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:41.172213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:41.180154 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0312e08e-ed36-4df1-9bb2-2761f8298294 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.149437 Jul 12 16:22:41.180956 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 64/137] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:41 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:41.245449 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:41.252686 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-561051f2-3cf9-4104-9684-6cb29a01e741 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.155725 Jul 12 16:22:41.253271 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 74/138] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:41 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:41.560487 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:41.561183 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:41.567157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:41.567606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:41.568367 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:41.568811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:41.702728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:41.715419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:41.718587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:41.719596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c49cac9a-bd35-42ed-81ec-92ef01ff319a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.163518 Jul 12 16:22:41.722974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 65/139] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:41 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:42.197640 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:42.198971 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:42.207524 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.208439 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.209552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.210209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.271819 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:42.272638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:42.286021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.299202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.300717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.303155 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.491622 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:42.507839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-25fb467f-7fe2-4ac4-9f62-536aebab4ead tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1368 microversion: 2.1 time: 0.314377 Jul 12 16:22:42.509072 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 75/140] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:42 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:42.516330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-c8081c6a-91ec-4b1e-a53a-7e3c31e14a37 req-8c5a5637-2513-4de6-b2b1-536f8fe36dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6459fa8-bfbc-40a1-af27-2d44bad65d98", "name": "network-vif-plugged", "status": "completed", "tag": "2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:42.525604 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-c8081c6a-91ec-4b1e-a53a-7e3c31e14a37 req-8c5a5637-2513-4de6-b2b1-536f8fe36dce service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.526095 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-c8081c6a-91ec-4b1e-a53a-7e3c31e14a37 req-8c5a5637-2513-4de6-b2b1-536f8fe36dce service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.538069 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-c8081c6a-91ec-4b1e-a53a-7e3c31e14a37 req-8c5a5637-2513-4de6-b2b1-536f8fe36dce service nova] Creating event network-vif-plugged:2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4 for instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 on hv-cinder-79760 Jul 12 16:22:42.543345 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-c8081c6a-91ec-4b1e-a53a-7e3c31e14a37 req-8c5a5637-2513-4de6-b2b1-536f8fe36dce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Jul 12 16:22:42.543937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 76/141] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:42.569174 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:42.577352 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-10ef9ce1-2307-4281-8fe6-2cfcc0179420 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.311765 Jul 12 16:22:42.577873 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 66/142] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:42 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:42.743095 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:42.744567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:42.751992 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.752753 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.754044 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.754662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.858363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-26e3b107-86ee-451e-bf1c-0a9cdfd1fc03 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9f851e5-54e5-4a95-82f1-b44246cf74fc"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:42.859622 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-26e3b107-86ee-451e-bf1c-0a9cdfd1fc03 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:42.866500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e3b107-86ee-451e-bf1c-0a9cdfd1fc03 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.867176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e3b107-86ee-451e-bf1c-0a9cdfd1fc03 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.868317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e3b107-86ee-451e-bf1c-0a9cdfd1fc03 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:42.869476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e3b107-86ee-451e-bf1c-0a9cdfd1fc03 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:42.916849 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:42.926503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:42.928226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:42.933663 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d3fca5c0-3537-47f3-a80c-4c1da1c8bac4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.192014 Jul 12 16:22:42.934857 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 77/143] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:42 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:43.526024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:43.527417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:43.534349 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:43.534914 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:43.535757 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:43.536235 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:43.720285 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:43.729382 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d58861a4-ddc4-455a-acc1-a01f82cde387 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1558 microversion: 2.1 time: 0.207536 Jul 12 16:22:43.742542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 78/144] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:43 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:43.779461 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:43.780107 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:43.799130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:43.799591 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:43.800578 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:43.801421 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:44.020663 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:44.029842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f4f8e7c7-6e5e-4fe0-874f-e4ae7f553403 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1322 microversion: 2.1 time: 0.289109 Jul 12 16:22:44.030672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 79/145] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:43 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:44.036605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e6091c33-fefb-4a14-919a-d11c7f54e724 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:44.037121 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e6091c33-fefb-4a14-919a-d11c7f54e724 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:44.043799 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e6091c33-fefb-4a14-919a-d11c7f54e724 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:44.044452 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e6091c33-fefb-4a14-919a-d11c7f54e724 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:44.045592 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e6091c33-fefb-4a14-919a-d11c7f54e724 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:44.046411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e6091c33-fefb-4a14-919a-d11c7f54e724 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:44.188844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e6091c33-fefb-4a14-919a-d11c7f54e724 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156912 Jul 12 16:22:44.189806 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 80/146] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:22:44 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:44.195389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:44.195993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:44.207594 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:44.208046 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:44.208798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:44.209272 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:44.462644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:44.790129 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-26e3b107-86ee-451e-bf1c-0a9cdfd1fc03 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "POST /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.934738 Jul 12 16:22:44.791658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 67/147] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:22:42 2022] POST /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f/os-volume_attachments => generated 194 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:22:44.901803 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:44.918147 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:44.919671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:44.920786 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-03d98fba-275a-4d46-8da2-2861e2466ef5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.729909 Jul 12 16:22:44.921701 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 81/148] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:44 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:45.055472 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:45.056184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:45.072080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.073189 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:45.074006 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.074985 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:45.312269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:45.323333 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f10a7965-0d76-4897-9dd5-79b7a05cfefc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1515 microversion: 2.1 time: 0.279973 Jul 12 16:22:45.325612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 68/149] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:45 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:45.344509 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:45.345955 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:45.358553 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.362721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:45.363793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.364821 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:45.416428 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lazy-loading 'flavor' on Instance uuid f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:22:45.687117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c2dbbc12-f235-423e-af4c-8540622e9db5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b/action" status: 200 len: 32 microversion: 2.1 time: 0.347125 Jul 12 16:22:45.691957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 82/150] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:22:45 2022] POST /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:22:45.702412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:45.703053 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:45.722887 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.723350 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:45.724328 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.728006 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:45.944359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:45.945412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:45.960043 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.962093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:45.964534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:45.966125 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:46.052463 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:46.063832 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0972f16a-ebfc-4da5-926f-684e3f910931 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.370721 Jul 12 16:22:46.064597 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 69/151] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:45 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:46.393469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:46.409496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:46.411299 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:46.412455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b8b54370-f01b-4e64-b15e-96bba3967af1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1407 microversion: 2.20 time: 0.476855 Jul 12 16:22:46.415223 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 83/152] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:45 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:46.421071 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-6981480e-6f47-4045-98ad-d0ff7f4e61f9 req-87dd7791-e95e-45a0-8af4-182f3f3a73d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b", "tag": "ee938d9d-4c97-4e36-891d-386db9564d75"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:46.431115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-6981480e-6f47-4045-98ad-d0ff7f4e61f9 req-87dd7791-e95e-45a0-8af4-182f3f3a73d5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:46.431944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-6981480e-6f47-4045-98ad-d0ff7f4e61f9 req-87dd7791-e95e-45a0-8af4-182f3f3a73d5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:46.452292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-6981480e-6f47-4045-98ad-d0ff7f4e61f9 req-87dd7791-e95e-45a0-8af4-182f3f3a73d5 service nova] Creating event network-changed:ee938d9d-4c97-4e36-891d-386db9564d75 for instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b on hv-cinder-79760 Jul 12 16:22:46.475379 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-6981480e-6f47-4045-98ad-d0ff7f4e61f9 req-87dd7791-e95e-45a0-8af4-182f3f3a73d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056561 Jul 12 16:22:46.478140 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 70/153] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:47.086646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:47.087097 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:47.097684 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:47.099113 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:47.103555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:47.104269 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:47.381809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:47.392613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-be1073ff-39c7-4f37-ad02-c22869eabdd8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.312998 Jul 12 16:22:47.393410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 84/154] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:47 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:47.439755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:47.440540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:47.449248 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:47.449728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:47.450545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:47.451067 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:47.862633 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:47.880308 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:47.883892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:47.885514 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bee89b34-56c0-41f7-b2b3-0d99721ab335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1598 microversion: 2.20 time: 0.451640 Jul 12 16:22:47.886232 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 71/155] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:22:47 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1598 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:22:47.908641 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-21092670-e2f2-4cf7-9d5b-7a064e0eb8c9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:47.909166 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-21092670-e2f2-4cf7-9d5b-7a064e0eb8c9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:47.917122 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-21092670-e2f2-4cf7-9d5b-7a064e0eb8c9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:47.917538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-21092670-e2f2-4cf7-9d5b-7a064e0eb8c9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:47.918868 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-21092670-e2f2-4cf7-9d5b-7a064e0eb8c9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:47.919315 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-21092670-e2f2-4cf7-9d5b-7a064e0eb8c9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:48.061023 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-21092670-e2f2-4cf7-9d5b-7a064e0eb8c9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.156291 Jul 12 16:22:48.062003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 85/156] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jul 12 16:22:47 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:22:48.410360 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:48.411201 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:48.419906 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:48.424380 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:48.425245 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:48.425684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:49.013291 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:49.024635 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-456b58bb-9a48-42d6-8c3f-815ebace8450 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.618104 Jul 12 16:22:49.026506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 72/157] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:48 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:50.043825 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:50.045288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:50.054752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:50.056048 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:50.057457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:50.058471 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:50.250564 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:50.260502 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d4d4e446-4393-497c-9740-50506ca230d6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.222852 Jul 12 16:22:50.263436 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 86/158] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:50 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:50.374129 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-e626c311-f8c4-41e9-b639-ecb116be5d1f req-47667119-8db8-4a8f-bced-29b68e12696a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6459fa8-bfbc-40a1-af27-2d44bad65d98", "tag": "2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:50.384344 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e626c311-f8c4-41e9-b639-ecb116be5d1f req-47667119-8db8-4a8f-bced-29b68e12696a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:50.385374 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e626c311-f8c4-41e9-b639-ecb116be5d1f req-47667119-8db8-4a8f-bced-29b68e12696a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:50.401352 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-e626c311-f8c4-41e9-b639-ecb116be5d1f req-47667119-8db8-4a8f-bced-29b68e12696a service nova] Creating event network-changed:2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4 for instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 on hv-cinder-79760 Jul 12 16:22:50.410638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-e626c311-f8c4-41e9-b639-ecb116be5d1f req-47667119-8db8-4a8f-bced-29b68e12696a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040827 Jul 12 16:22:50.411444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 73/159] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:22:51.281990 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:51.283173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:51.296982 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:51.297529 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:51.298320 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:51.302096 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:51.488369 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:51.511030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-067d74ef-5958-407f-8b6c-083756c4c4de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.234991 Jul 12 16:22:51.512266 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 87/160] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:51 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:52.529681 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:52.530304 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:52.532460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=84 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:52.538812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:52.539262 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:52.540029 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:52.540658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:52.713325 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:52.722098 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2683c3e6-e7d2-491f-ac47-f43743bab170 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.197846 Jul 12 16:22:52.722992 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 74/161] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:52 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:53.740284 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:53.742028 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:53.749766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:53.750527 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:53.751999 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:53.752676 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:53.929413 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:53.937991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-559f620e-c718-47ac-8bb2-f21d17a35a08 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.202567 Jul 12 16:22:53.938695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 88/162] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:53 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:54.955678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:54.956819 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:54.963648 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:54.964090 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:54.964889 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:54.965527 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:55.110112 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:55.125376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b01fdd23-9ec5-4953-acb6-faf79d5c6aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.173309 Jul 12 16:22:55.125962 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 75/163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:54 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:55.169603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:55.170157 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:55.176333 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:55.181239 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:55.182269 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:55.183032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:55.209941 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:22:55.241501 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:55.307837 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9a5e2ff4-5a38-4e01-9b48-a1acd58d770e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 204 len: 0 microversion: 2.1 time: 0.144015 Jul 12 16:22:55.313037 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 89/164] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:22:55 2022] DELETE /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:22:55.318836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:55.320285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:55.334156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:55.335660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:55.341391 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:55.341967 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:55.503953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:55.512568 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e0d8c700-a5d4-43be-8fbd-b30123476ee9 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.198286 Jul 12 16:22:55.513158 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 76/165] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:55 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:56.142395 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:56.143103 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:56.149129 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:56.149579 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:56.150337 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:56.150780 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:56.275215 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:56.282642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-89b1a469-76d4-4514-87ce-f2e1abc378b8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.144438 Jul 12 16:22:56.283199 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 90/166] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:56 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:56.529422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:56.530059 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:56.536540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:56.536985 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:56.537765 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:56.538203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:56.670526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:56.678486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7a40b7fb-d865-4271-afa8-24f00a0e3d22 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.152943 Jul 12 16:22:56.680028 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 77/167] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:56 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:57.299267 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:57.299902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:57.305898 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:57.306354 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:57.307113 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:57.307552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:57.436413 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:57.444487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-117bc887-0f98-46f9-ad62-9cd03231723d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.148991 Jul 12 16:22:57.446472 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 91/168] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:57 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:57.695655 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:57.696551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:57.703458 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:57.703911 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:57.704681 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:57.705149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:57.831566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:57.839499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8d4a1bb2-0444-4bf9-b830-a2b44aae6d70 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.147923 Jul 12 16:22:57.840067 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 78/169] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:57 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:58.462504 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:58.463108 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:58.469577 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:58.470015 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:58.470762 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:58.471192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:58.598136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:58.605478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3d8e0866-f9c2-4297-8c08-f7ef43f12cdb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.146814 Jul 12 16:22:58.606038 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 92/170] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:58 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:58.856841 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:58.857602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:58.864829 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:58.865323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:58.866099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:58.866534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:59.003410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:59.011225 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5ac584b0-46b0-4899-b9c5-2b59565c13e2 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.158668 Jul 12 16:22:59.012456 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 79/171] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:58 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:22:59.620175 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1270959296", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:22:59.622191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:22:59.622866 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:22:59.628901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:59.629440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:59.630264 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:59.630760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:59.669648 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] validate_networks() for None {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:22:59.758587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:22:59.766719 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3d0cc498-1da7-4a0b-9e93-bf3d0e5a363f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.148813 Jul 12 16:22:59.767293 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 80/172] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:22:59 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:22:59.944766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:22:59.945213 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:22:59.945679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:22:59.946106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:22:59.946514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:22:59.955962 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:59.956404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:59.957248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:22:59.957645 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:22:59.974803 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Getting quotas for project d5a871129c57482fa6e7018b3363c6dc. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:22:59.978708 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Getting quotas for user 06299eacc24e40669873ca15d110865a and project d5a871129c57482fa6e7018b3363c6dc. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:22:59.989931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:22:59.992241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:23:00.029434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:00.036997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-964488ef-6d2c-4279-9aae-eb283c86e63b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420622 Jul 12 16:23:00.037910 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 93/173] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:23:00.038295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:00.046828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:00.047568 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:00.048722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:00.050250 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:00.063167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9621d7e0-650a-4d00-8654-56945f887a98 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:00.063896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9621d7e0-650a-4d00-8654-56945f887a98 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:00.124304 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9621d7e0-650a-4d00-8654-56945f887a98 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:00.133322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9621d7e0-650a-4d00-8654-56945f887a98 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1215 microversion: 2.1 time: 0.080708 Jul 12 16:23:00.133991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 94/174] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:00 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:00.207285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:00.216297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2d2e21f3-b4da-4d5f-aa8e-a406e2de4a90 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.191371 Jul 12 16:23:00.216945 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 81/175] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:00 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:00.783452 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:00.784058 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:00.790079 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:00.790531 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:00.791286 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:00.791721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:00.920743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:00.928221 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-74f0cd45-ace2-4619-b651-c156357639b9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.148580 Jul 12 16:23:00.928864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 95/176] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:00 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:01.150001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:01.150639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:01.156987 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:01.157467 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:01.158218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:01.158655 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:01.220192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:01.227434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3668a90a-f375-422c-bdeb-ea494d99b3fc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1219 microversion: 2.1 time: 0.081250 Jul 12 16:23:01.228171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 82/177] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:01 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:01.233589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:01.234198 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:01.240309 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:01.240748 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:01.241538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:01.241967 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:01.366302 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:01.374181 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-dce3622d-4019-4cce-8356-6920f32786e3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.145000 Jul 12 16:23:01.374768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 96/178] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:01 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:01.944724 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:01.945351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:01.951863 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:01.952302 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:01.953069 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:01.953499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:02.079523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:02.086837 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8d803d9d-e385-4cc2-989f-10362dc61869 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.145928 Jul 12 16:23:02.087403 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 83/179] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:01 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:02.244712 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:02.245344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:02.251660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:02.252272 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:02.253025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:02.253480 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:02.312527 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:02.320259 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d12d00c9-f482-422d-a520-f03297cad4a3 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1219 microversion: 2.1 time: 0.079308 Jul 12 16:23:02.320816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 97/180] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:02 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:02.391624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:02.392218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:02.399983 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:02.400430 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:02.401224 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:02.401679 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:02.531918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:02.535250 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:02.540993 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d38d9a94-198e-402a-a8f7-47473a5b87dc tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.153461 Jul 12 16:23:02.541594 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 84/181] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:02 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:03.105246 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:03.106714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:03.118024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:03.119240 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:03.120258 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:03.120764 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:03.339021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:03.340433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:03.348646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:03.349224 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:03.350197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:03.350867 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:03.417726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:03.425866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f20742a2-1b76-4c9e-8dc8-5fbde045dd96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.325704 Jul 12 16:23:03.426440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 98/182] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:03 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:03.457557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:03.470273 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ccc944c8-ad85-442f-9a63-23555ba67c11 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1273 microversion: 2.1 time: 0.136112 Jul 12 16:23:03.473680 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 85/183] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:03 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:03.560388 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:03.561307 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:03.568059 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:03.568941 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:03.569733 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:03.570234 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:03.805677 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:03.832401 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a8a80c2d-86de-4e71-9852-85cdd060df2e tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1553 microversion: 2.1 time: 0.277792 Jul 12 16:23:03.845735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 99/184] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:03 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:03.906545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-5cc66d59-870e-47cc-a203-6a2079dd703f req-ed37d4b8-6c57-4aa0-8163-db811162ab52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8b44ee-7b55-4959-ae86-6ab7c888a36f", "name": "network-vif-deleted", "tag": "1f91d14b-ab01-4c87-89c1-746a8fecfb93"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:03.927166 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5cc66d59-870e-47cc-a203-6a2079dd703f req-ed37d4b8-6c57-4aa0-8163-db811162ab52 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:03.927868 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5cc66d59-870e-47cc-a203-6a2079dd703f req-ed37d4b8-6c57-4aa0-8163-db811162ab52 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:03.944964 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-5cc66d59-870e-47cc-a203-6a2079dd703f req-ed37d4b8-6c57-4aa0-8163-db811162ab52 service nova] Creating event network-vif-deleted:1f91d14b-ab01-4c87-89c1-746a8fecfb93 for instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f on hv-cinder-79760 Jul 12 16:23:03.962681 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-5cc66d59-870e-47cc-a203-6a2079dd703f req-ed37d4b8-6c57-4aa0-8163-db811162ab52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068329 Jul 12 16:23:03.965471 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 86/185] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:04.445315 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:04.446646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:04.455296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:04.456250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:04.457689 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:04.458523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:04.488920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:04.489913 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:04.502690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:04.503146 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:04.503921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:04.504393 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:04.665653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:04.675226 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-73bdc80a-06d4-4264-a7d2-54e871a8680b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.191089 Jul 12 16:23:04.685746 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 87/186] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:04 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:04.806504 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:04.819483 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ae5bbc29-6f2c-4d0a-a6cb-34ee43cca2ff tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.379253 Jul 12 16:23:04.829590 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 100/187] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:04 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:04.856474 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:04.857960 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:04.866453 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:04.867259 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:04.868245 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:04.868736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:04.930500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:04.931128 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:04.931683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lazy-loading 'fault' on Instance uuid 6b8b44ee-7b55-4959-ae86-6ab7c888a36f {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:23:04.983636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3250ed88945641af86eb5b17c1917536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f025a4155ef47b69781bca71bc74c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:04.993439 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c69c0217-e6e7-4b38-8297-29386f232468 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 200 len: 1304 microversion: 2.1 time: 0.144267 Jul 12 16:23:04.997621 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 88/188] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:04 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:05.333845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-d1dd2485-0e7d-4505-ac3d-be0c3a089dc2 req-cab7b3c9-7566-45ef-a2a5-abfb452906a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f43a23b-99e9-453d-ba19-9fe2e0958694", "tag": "ffc60055-fa5b-4ea6-a18c-8d7d92a9073a"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:05.362536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-d1dd2485-0e7d-4505-ac3d-be0c3a089dc2 req-cab7b3c9-7566-45ef-a2a5-abfb452906a0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:05.369986 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-d1dd2485-0e7d-4505-ac3d-be0c3a089dc2 req-cab7b3c9-7566-45ef-a2a5-abfb452906a0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:05.426478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-d1dd2485-0e7d-4505-ac3d-be0c3a089dc2 req-cab7b3c9-7566-45ef-a2a5-abfb452906a0 service nova] Creating event network-changed:ffc60055-fa5b-4ea6-a18c-8d7d92a9073a for instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 on hv-cinder-79760 Jul 12 16:23:05.445868 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-d1dd2485-0e7d-4505-ac3d-be0c3a089dc2 req-cab7b3c9-7566-45ef-a2a5-abfb452906a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113547 Jul 12 16:23:05.452662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 101/189] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:05.692206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:05.692825 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:05.712097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:05.712550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:05.713348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:05.718898 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:05.838562 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:05.840309 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:05.852314 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:05.853009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:05.854259 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:05.855005 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:05.952660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:05.962364 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ca09e7cb-6925-4b24-b6c4-9982da02f37e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.273935 Jul 12 16:23:05.963815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 89/190] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:05 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:06.013637 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:06.014708 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:06.023592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:06.024052 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:06.024859 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:06.025439 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:06.063731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] HTTP exception thrown: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Request method failure captured: Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f HTTP/1.1 Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kJGgKzUZREZgWF3u-e6tBKh2trUkmbt9k_coVna8q1sCP4xoarlDcLLFUbtErdemEdNKskMcfyCc8cfvvLmJVmiytPwEOmz5xXlGzqsqU7Fj6ImYS6xgWzlivcz5yq-JhSCP3PMJkBC7TCqYOwU0Rq-eFE2lW9_ev-bjSr_1SjC0 Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:23:06.069489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f025a4155ef47b69781bca71bc74c49", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 3250ed88945641af86eb5b17c1917536 Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.071010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '6b8b44ee-7b55-4959-ae86-6ab7c888a36f'} Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:23:06.071815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.072995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.075497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Returning 404 to user: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:23:06.075937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d903170d-8868-4b6a-8784-beaa45ca88bb tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 404 len: 111 microversion: 2.1 time: 0.067522 Jul 12 16:23:06.079769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 90/191] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:06 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:23:06.137587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:06.157602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ec2506f0-5468-4fe2-a2f3-1b310880b0c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.320903 Jul 12 16:23:06.160059 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 102/192] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:05 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:06.208296 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:06.209901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:06.218560 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:06.219123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:06.220122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:06.220626 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:06.245630 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] HTTP exception thrown: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Request method failure captured: Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f/os-volume_attachments HTTP/1.1 Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kJGgKzUZREZgWF3u-e6tBKh2trUkmbt9k_coVna8q1sCP4xoarlDcLLFUbtErdemEdNKskMcfyCc8cfvvLmJVmiytPwEOmz5xXlGzqsqU7Fj6ImYS6xgWzlivcz5yq-JhSCP3PMJkBC7TCqYOwU0Rq-eFE2lW9_ev-bjSr_1SjC0 Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:23:06.249358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f025a4155ef47b69781bca71bc74c49", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 3250ed88945641af86eb5b17c1917536 Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.251221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'server_id': '6b8b44ee-7b55-4959-ae86-6ab7c888a36f'} Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:23:06.251907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:06.253008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:06.255315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Returning 404 to user: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:23:06.257275 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a1a035f5-0617-4744-99e8-eb8849095f19 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054582 Jul 12 16:23:06.258014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 91/193] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:23:06 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 16:23:06.980825 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:06.981455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:06.987832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:06.988494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:06.989543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:06.989983 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:07.128096 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:07.141283 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8bc50bb1-48c6-45ac-bd46-1aebf80e348d tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.164136 Jul 12 16:23:07.142717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 103/194] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:06 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:07.175419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:07.176678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:07.184818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:07.185551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:07.186490 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:07.187106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:07.441249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:07.449838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6fcc477c-c397-4563-97e2-20a410782086 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.278360 Jul 12 16:23:07.450721 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 92/195] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:07 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:07.510329 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:07.510996 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:07.518503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:07.518950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:07.519711 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:07.520139 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:07.534558 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] HTTP exception thrown: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Request method failure captured: Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f HTTP/1.1 Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kJGgKzUZREZgWF3u-e6tBKh2trUkmbt9k_coVna8q1sCP4xoarlDcLLFUbtErdemEdNKskMcfyCc8cfvvLmJVmiytPwEOmz5xXlGzqsqU7Fj6ImYS6xgWzlivcz5yq-JhSCP3PMJkBC7TCqYOwU0Rq-eFE2lW9_ev-bjSr_1SjC0 Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:23:07.539366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f025a4155ef47b69781bca71bc74c49", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 3250ed88945641af86eb5b17c1917536 Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.540567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '6b8b44ee-7b55-4959-ae86-6ab7c888a36f'} Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:23:07.541538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.542652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.543829 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Returning 404 to user: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:23:07.543829 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5127ab68-8a7e-48d3-87b3-7ab69b7bb0c3 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 404 len: 111 microversion: 2.1 time: 0.034274 Jul 12 16:23:07.543829 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 104/196] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:23:07 2022] DELETE /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:23:07.549830 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:07.550448 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] [instance: 6b8b44ee-7b55-4959-ae86-6ab7c888a36f] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:07.556507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:07.556962 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:07.557789 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:07.558268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:07.573653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] HTTP exception thrown: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Request method failure captured: Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f HTTP/1.1 Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kJGgKzUZREZgWF3u-e6tBKh2trUkmbt9k_coVna8q1sCP4xoarlDcLLFUbtErdemEdNKskMcfyCc8cfvvLmJVmiytPwEOmz5xXlGzqsqU7Fj6ImYS6xgWzlivcz5yq-JhSCP3PMJkBC7TCqYOwU0Rq-eFE2lW9_ev-bjSr_1SjC0 Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:23:07.575858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f025a4155ef47b69781bca71bc74c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f025a4155ef47b69781bca71bc74c49", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 8f025a4155ef47b69781bca71bc74c49 Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-DeleteServersTestJSON-228807283 Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 3250ed88945641af86eb5b17c1917536 Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-DeleteServersTestJSON-228807283-project Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.577025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '6b8b44ee-7b55-4959-ae86-6ab7c888a36f'} Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:23:07.581562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. Jul 12 16:23:07.582726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:23:07.583663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] Returning 404 to user: Instance 6b8b44ee-7b55-4959-ae86-6ab7c888a36f could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:23:07.583663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dfcbe3e9-2ace-42dd-8406-d0eb4fedd011 tempest-DeleteServersTestJSON-228807283 tempest-DeleteServersTestJSON-228807283-project] 10.222.0.20 "GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f" status: 404 len: 111 microversion: 2.1 time: 0.031384 Jul 12 16:23:07.583663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 93/197] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:07 2022] GET /compute/v2.1/servers/6b8b44ee-7b55-4959-ae86-6ab7c888a36f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:23:08.160184 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:08.160811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:08.167386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:08.168365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:08.169186 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:08.169629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:08.354883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:08.363083 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f2267a47-2d48-435d-a7fb-23608255dc83 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.207832 Jul 12 16:23:08.365247 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 105/198] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:08 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:08.467138 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:08.467858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:08.474393 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:08.474837 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:08.475782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:08.476431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:08.708577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:08.721503 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2d3d27a4-15d7-42c9-8109-5f908f39f919 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.258287 Jul 12 16:23:08.722353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 94/199] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:08 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:09.380301 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:09.380908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:09.388638 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:09.389301 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:09.390292 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:09.390726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:09.522950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:09.530445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-dbc8bd40-1dae-4865-b5f1-058f20af5241 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.153943 Jul 12 16:23:09.531017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 106/200] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:09 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:09.748076 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:09.749043 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:09.756111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:09.756657 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:09.757486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:09.758013 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:10.114555 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:10.127449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4e096b33-97b4-4721-8957-92d5fe647a53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.384594 Jul 12 16:23:10.138690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 95/201] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:09 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:10.548075 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:10.548820 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:10.551925 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:10.553227 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=8 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:10.568358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:10.572782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:10.574909 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:10.578282 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:10.890613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:10.898742 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-70d3c82c-4b73-443b-aea5-46ba220e2d19 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.355224 Jul 12 16:23:10.899340 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 107/202] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:10 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:11.144670 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:11.145348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:11.159398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:11.159949 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:11.160952 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:11.161607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:11.335691 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:11.344231 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b79fcf4f-7369-4005-bc4a-d8bd0c4ead23 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.203669 Jul 12 16:23:11.345787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 96/203] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:11 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:11.916068 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:11.918345 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:11.930891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:11.936517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:11.936980 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:11.938224 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:11.938313 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:11.983238 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:12.156320 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:12.164802 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-73e868cd-65ff-4526-a51e-25801e5606bc tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.252953 Jul 12 16:23:12.175101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 108/204] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:11 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:12.351021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-698601390", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "networks": [{"uuid": "50b0be25-bbf0-44c2-8fb7-d8d8eb2dff5a"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:12.363043 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:12.364484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:12.374038 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:12.374770 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:12.391940 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:12.394606 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:12.443514 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] validate_networks() for [('50b0be25-bbf0-44c2-8fb7-d8d8eb2dff5a', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:23:12.590022 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:12.599540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c677d7bd-6a9a-446b-8371-0a46b5744655 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.239626 Jul 12 16:23:12.600142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 109/205] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:12 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:12.615192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-3a422485-bc46-4f05-ae30-54235c780805 req-2faac44e-ee95-494b-9a87-766bbe92607c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f43a23b-99e9-453d-ba19-9fe2e0958694", "name": "network-vif-plugged", "status": "completed", "tag": "ffc60055-fa5b-4ea6-a18c-8d7d92a9073a"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:12.624966 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-3a422485-bc46-4f05-ae30-54235c780805 req-2faac44e-ee95-494b-9a87-766bbe92607c service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:12.625747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-3a422485-bc46-4f05-ae30-54235c780805 req-2faac44e-ee95-494b-9a87-766bbe92607c service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:12.639060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-3a422485-bc46-4f05-ae30-54235c780805 req-2faac44e-ee95-494b-9a87-766bbe92607c service nova] Creating event network-vif-plugged:ffc60055-fa5b-4ea6-a18c-8d7d92a9073a for instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 on hv-cinder-79760 Jul 12 16:23:12.645266 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-3a422485-bc46-4f05-ae30-54235c780805 req-2faac44e-ee95-494b-9a87-766bbe92607c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034195 Jul 12 16:23:12.646488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 110/206] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:13.138416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:23:13.139030 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:23:13.139512 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:23:13.139927 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:23:13.140348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:23:13.149850 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:13.150431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:13.151380 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:13.152376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:13.170108 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Getting quotas for project 4c0e47ebace74e88b8b501586b5b501d. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:23:13.174145 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Getting quotas for user afa10c2abc41408fb95a212bdb9049bc and project 4c0e47ebace74e88b8b501586b5b501d. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:23:13.183017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:13.185143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:13.192304 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:13.192999 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:13.193979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:13.194186 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:23:13.194723 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:13.196914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:23:13.271789 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-73dd2a48-5e13-4759-8653-9d779bfa20c5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924590 Jul 12 16:23:13.274168 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 97/207] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:23:13.287801 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-af2bf496-fb80-4e13-a1d1-093715b70921 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:13.289665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-af2bf496-fb80-4e13-a1d1-093715b70921 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:13.372219 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:13.376421 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-af2bf496-fb80-4e13-a1d1-093715b70921 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:13.383082 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7f4b2630-85b3-4f0d-9086-f23eb41ecfa7 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.203792 Jul 12 16:23:13.384163 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-af2bf496-fb80-4e13-a1d1-093715b70921 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1213 microversion: 2.1 time: 0.104183 Jul 12 16:23:13.385382 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 98/208] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:13 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:13.401313 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 111/209] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:13 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:13.618476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:13.619405 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:13.627602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:13.628331 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:13.629620 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:13.630335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:13.819790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:13.830704 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-87a6b668-ca4e-4285-8956-01b0bafde4e7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.218250 Jul 12 16:23:13.831489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 99/210] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:13 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:14.408442 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:14.409075 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:14.409390 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:14.410064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:14.416398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:14.416858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:14.418211 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:14.424789 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:14.425275 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:14.426049 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:14.426486 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:14.431200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:14.541945 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:14.550920 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fe75ca3c-02fb-4989-bbb9-29974b1eb44f tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1265 microversion: 2.1 time: 0.152593 Jul 12 16:23:14.551503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 112/211] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:14 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:14.670920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:14.684728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4e9edda1-f036-47a8-8e44-8f285bf38f9e tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1315 microversion: 2.1 time: 0.279875 Jul 12 16:23:14.686068 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 100/212] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:14 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:14.847649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:14.848251 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:14.854230 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:14.854621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:14.855583 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:14.856013 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:15.071801 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:15.080423 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3439df25-1f14-4f4e-a786-ff7e9f1ed1db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.236486 Jul 12 16:23:15.081377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 113/213] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:14 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:15.574923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:15.576779 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:15.584415 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:15.585419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:15.587541 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:15.588166 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:15.666331 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:15.678977 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-85872872-af37-44cc-bea7-178a374dfe1d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1271 microversion: 2.1 time: 0.113499 Jul 12 16:23:15.679965 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 101/214] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:15 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:15.703941 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:15.705211 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:15.722993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:15.723660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:15.726228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:15.726228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:15.957937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:15.972295 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1f3c4988-c09a-4939-86bf-8d6976969d2b tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1465 microversion: 2.1 time: 0.273704 Jul 12 16:23:15.988421 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 114/215] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:15 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1465 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:16.046520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:16.047082 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:16.054313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.054896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.055682 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.056101 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.087163 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:23:16.097373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:16.097982 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:16.105756 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.108102 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.109206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.109847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.305992 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5c1ec7d1-d8f0-4575-a08c-8e0665ffbe61 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 204 len: 0 microversion: 2.1 time: 0.267893 Jul 12 16:23:16.310435 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 102/216] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:23:16 2022] DELETE /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:23:16.318210 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:16.319132 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:16.339010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.339684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.340656 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.341120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.510747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:16.513406 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:16.517120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:16.527410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9fda7390-c989-4e9c-8b95-d0eb5431504a tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1471 microversion: 2.1 time: 0.214881 Jul 12 16:23:16.528702 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 103/217] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:16 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:16.529715 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d60fc0cd-fa0d-44e2-a0d9-a43435fd399e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.434849 Jul 12 16:23:16.530741 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 115/218] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:16 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:16.696600 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:16.697789 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:16.705650 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.706409 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.707739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.708526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.850085 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-12147639-f4da-4370-945b-fc94d90e8c50 req-a89d2dff-7be4-4770-a606-895584ee1ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf12c4b-f23c-4461-93ca-c0a1d54043d5", "tag": "b7a744e4-9b6c-441e-967a-06dc983801c7"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:16.860924 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-12147639-f4da-4370-945b-fc94d90e8c50 req-a89d2dff-7be4-4770-a606-895584ee1ee2 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:16.862465 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-12147639-f4da-4370-945b-fc94d90e8c50 req-a89d2dff-7be4-4770-a606-895584ee1ee2 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:16.885490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-12147639-f4da-4370-945b-fc94d90e8c50 req-a89d2dff-7be4-4770-a606-895584ee1ee2 service nova] Creating event network-changed:b7a744e4-9b6c-441e-967a-06dc983801c7 for instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 on hv-cinder-79760 Jul 12 16:23:16.891311 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-12147639-f4da-4370-945b-fc94d90e8c50 req-a89d2dff-7be4-4770-a606-895584ee1ee2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044791 Jul 12 16:23:16.892212 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 116/219] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:23:16.938926 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:16.946974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ece5d16a-b04c-4ac4-b91b-cef9226ad007 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.255103 Jul 12 16:23:16.956817 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 104/220] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:16 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:17.552131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:17.554196 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:17.555106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:17.556255 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:17.567477 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:17.567963 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:17.568862 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:17.571496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:17.571892 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:17.572652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:17.573310 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:17.578809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:17.755625 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:17.763967 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-92bc1c64-44c9-421c-8c77-6784723c1c66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.220634 Jul 12 16:23:17.764680 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 105/221] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:17 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:17.818545 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:17.826825 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-606ea52b-66ca-4dca-ad2e-c25357cc372f tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1471 microversion: 2.1 time: 0.282371 Jul 12 16:23:17.827578 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 117/222] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:17 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:17.965256 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:17.965893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:17.984749 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:17.985295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:17.986418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:17.987202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:18.217590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:18.225928 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8088107a-806e-43c8-8eb6-1282d2684fc1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.265726 Jul 12 16:23:18.226539 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 106/223] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:17 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:18.577906 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-c34d5ae4-2313-49e0-8d8b-b95c3c7b5e62 req-300ba504-c20a-4eb7-a666-f69a074191b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f43a23b-99e9-453d-ba19-9fe2e0958694", "name": "network-vif-deleted", "tag": "ffc60055-fa5b-4ea6-a18c-8d7d92a9073a"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:18.592156 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-c34d5ae4-2313-49e0-8d8b-b95c3c7b5e62 req-300ba504-c20a-4eb7-a666-f69a074191b6 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:18.592859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-c34d5ae4-2313-49e0-8d8b-b95c3c7b5e62 req-300ba504-c20a-4eb7-a666-f69a074191b6 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:18.605766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-c34d5ae4-2313-49e0-8d8b-b95c3c7b5e62 req-300ba504-c20a-4eb7-a666-f69a074191b6 service nova] Creating event network-vif-deleted:ffc60055-fa5b-4ea6-a18c-8d7d92a9073a for instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 on hv-cinder-79760 Jul 12 16:23:18.612981 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-c34d5ae4-2313-49e0-8d8b-b95c3c7b5e62 req-300ba504-c20a-4eb7-a666-f69a074191b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039173 Jul 12 16:23:18.614851 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 118/224] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:18.781771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:18.782500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:18.789528 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:18.789978 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:18.790754 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:18.791202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:18.845942 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:18.846647 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:18.854118 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:18.854574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:18.855960 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:18.856437 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:18.907489 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:18.908155 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:18.908710 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lazy-loading 'fault' on Instance uuid 0f43a23b-99e9-453d-ba19-9fe2e0958694 {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:23:18.959220 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:18.965207 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:18.967755 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3eb0b7b1-2dff-40e2-ab86-e9d8ac8f4d24 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1305 microversion: 2.1 time: 0.127686 Jul 12 16:23:18.968467 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 119/225] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:18 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:18.973085 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d4eef372-d79f-450e-bfc7-ee3be9474003 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.195853 Jul 12 16:23:18.974144 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 107/226] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:18 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:19.244818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:19.250395 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:19.251546 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:19.251995 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:19.252752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:19.253207 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:19.394384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:19.402263 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3be33c66-5829-4eb5-ac07-a35b6e6f3263 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.161986 Jul 12 16:23:19.402833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 120/227] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:19 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:19.986256 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:19.986987 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:19.994541 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:19.995031 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:19.996298 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:19.996419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:19.997278 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:19.997770 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:20.004341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:20.004794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:20.005671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:20.006117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:20.038393 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:20.039086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:20.039681 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lazy-loading 'fault' on Instance uuid 0f43a23b-99e9-453d-ba19-9fe2e0958694 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:23:20.086110 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06299eacc24e40669873ca15d110865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a871129c57482fa6e7018b3363c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:20.093329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-72f9bb50-a247-48a4-84d6-7e94c48066c9 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 200 len: 1305 microversion: 2.1 time: 0.112325 Jul 12 16:23:20.094063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 108/228] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:19 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:20.149745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:20.157894 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-789448af-1682-44bf-9ef6-d1c1f9295941 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.167429 Jul 12 16:23:20.158462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 121/229] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:19 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:20.421734 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:20.422476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:20.429688 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:20.430241 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:20.431115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:20.432057 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:20.576464 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:20.584604 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8713a3ee-9a15-4e3d-a84c-79e0132cf046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.168712 Jul 12 16:23:20.585587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 109/230] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:20 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:21.110322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:21.110982 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] [instance: 0f43a23b-99e9-453d-ba19-9fe2e0958694] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:21.118255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:21.118792 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:21.119630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:21.120130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:21.138168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] HTTP exception thrown: Instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 could not be found. Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Request method failure captured: Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 HTTP/1.1 Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ_eglE9qUJeFivYqs9-C04S08rkeUkn3NKTrzSREX2f_VEgN__irUPwYq_EvbN390n98mKvbtqJsGlOnUg71tlJMWjcxMUDcg_qY_8ptxFdl0yBdVZ0zm-NMeN3TEQdNS1YhZ63KN8lFEfsNeDL94YhreUGf5aEvc-UyAIzwqx7obc Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5a871129c57482fa6e7018b3363c6dc Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesNegativeTest-1782223720 Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:23:21.140559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5a871129c57482fa6e7018b3363c6dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5a871129c57482fa6e7018b3363c6dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5a871129c57482fa6e7018b3363c6dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5a871129c57482fa6e7018b3363c6dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesNegativeTest-1782223720 Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5a871129c57482fa6e7018b3363c6dc Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesNegativeTest-1782223720 Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesNegativeTest-1782223720-project Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 06299eacc24e40669873ca15d110865a Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesNegativeTest-1782223720-project Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 could not be found. Jul 12 16:23:21.141791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '0f43a23b-99e9-453d-ba19-9fe2e0958694'} Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 could not be found. Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:23:21.142574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 could not be found. Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 could not be found. Jul 12 16:23:21.143625 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:21.150859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] Returning 404 to user: Instance 0f43a23b-99e9-453d-ba19-9fe2e0958694 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:23:21.150859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5b598c02-6d35-43a2-8454-2aeb909a6141 tempest-VolumesNegativeTest-1782223720 tempest-VolumesNegativeTest-1782223720-project] 10.222.0.20 "GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694" status: 404 len: 111 microversion: 2.1 time: 0.036042 Jul 12 16:23:21.150859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 122/231] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:21 2022] GET /compute/v2.1/servers/0f43a23b-99e9-453d-ba19-9fe2e0958694 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:23:21.176793 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:21.177630 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:21.187311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:21.187844 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:21.188501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:21.188929 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:21.340613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:21.348723 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9995cb7d-3567-4660-994d-b52ce4c776ee tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.177822 Jul 12 16:23:21.357341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 110/232] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:21 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:21.601528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:21.602140 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:21.613798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:21.614500 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:21.615268 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:21.615698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:21.812224 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:21.826794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e7775d0c-7497-453b-a9fe-024f258ea849 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.228915 Jul 12 16:23:21.837881 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 123/233] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:21 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:22.366367 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:22.367733 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:22.374526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:22.381761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:22.385759 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:22.387638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:22.390003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:22.639311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:22.649321 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0bf4ed63-21b4-4b38-952f-c5b0a01f30b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.287093 Jul 12 16:23:22.650606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 111/234] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:22 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:22.843728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:22.844475 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:22.854046 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:22.854572 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:22.856899 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:22.858870 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:23.043085 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:23.051367 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f1264fe1-b460-47e0-ada9-2fa0f009eab2 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.211597 Jul 12 16:23:23.052580 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 124/235] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:22 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:23.666449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:23.667058 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:23.669706 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:23.671657 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=8 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:23.679444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:23.681097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:23.682674 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:23.688750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:23.871003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:23.879257 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7370a50b-d294-4933-a0b4-fb6b6c3f48db tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.216795 Jul 12 16:23:23.889423 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 112/236] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:23 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:24.068208 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:24.068942 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:24.077126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:24.077953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:24.078949 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:24.079550 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:24.259367 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:24.272094 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f421b40b-fe77-42e9-a11d-10e19e4502b5 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.207685 Jul 12 16:23:24.272954 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 125/237] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:24 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:24.466841 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-69ac1464-4d9c-4a45-8646-87e909f0aca7 req-030fbe0c-6e52-4c9f-a1c4-db6750581688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf12c4b-f23c-4461-93ca-c0a1d54043d5", "name": "network-vif-plugged", "status": "completed", "tag": "b7a744e4-9b6c-441e-967a-06dc983801c7"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:24.475742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-69ac1464-4d9c-4a45-8646-87e909f0aca7 req-030fbe0c-6e52-4c9f-a1c4-db6750581688 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:24.476386 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-69ac1464-4d9c-4a45-8646-87e909f0aca7 req-030fbe0c-6e52-4c9f-a1c4-db6750581688 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:24.491506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-69ac1464-4d9c-4a45-8646-87e909f0aca7 req-030fbe0c-6e52-4c9f-a1c4-db6750581688 service nova] Creating event network-vif-plugged:b7a744e4-9b6c-441e-967a-06dc983801c7 for instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 on hv-cinder-79760 Jul 12 16:23:24.498575 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-69ac1464-4d9c-4a45-8646-87e909f0aca7 req-030fbe0c-6e52-4c9f-a1c4-db6750581688 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 Jul 12 16:23:24.499566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 113/238] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:24.897460 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:24.898362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:24.904448 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:24.905214 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:24.906325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:24.906878 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:25.084528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:25.095648 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-77176fba-5038-431f-b9bf-d80d853dbc12 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1521 microversion: 2.1 time: 0.202600 Jul 12 16:23:25.096351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 126/239] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:24 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:25.290196 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:25.291476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:25.301499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:25.301499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:25.301785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:25.302692 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:25.446395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:25.454958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-930edd4a-a6f6-42df-9acd-783a21ee6f6c tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.169678 Jul 12 16:23:25.455571 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 114/240] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:25 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:26.113236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:26.114467 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:26.122562 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:26.123670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:26.125018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:26.125582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:26.148994 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:26.264295 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:26.271676 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a198cdae-fd90-43ac-9100-0f828b9f5325 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1501 microversion: 2.1 time: 0.162336 Jul 12 16:23:26.272247 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 127/241] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:26 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:26.287209 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:26.287745 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:26.294243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:26.294810 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:26.295646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:26.296164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:26.437086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:26.444602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-765f47c8-5a4d-4104-a172-1a2864f61ba9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1515 microversion: 2.1 time: 0.161271 Jul 12 16:23:26.445192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 115/242] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:26 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:26.474218 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:26.475177 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:26.486205 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:26.486711 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:26.489530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:26.490108 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:26.677870 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:26.685918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-535336ce-1aa8-460b-a13f-5855d72fcc36 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1313 microversion: 2.1 time: 0.217064 Jul 12 16:23:26.686482 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 128/243] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:26 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:27.770144 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:27.774013 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:27.781336 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:27.781851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:27.782682 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:27.783119 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:27.893419 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:27.895427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:27.905774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:27.906366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:27.907244 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:27.907870 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:27.932786 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lazy-loading 'flavor' on Instance uuid 97836b86-898a-44df-a529-4ebf4089cdbd {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:23:28.009110 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:28.016852 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f4ee688d-b3bf-4f11-b2e4-4f0e2d3d9090 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd/action" status: 200 len: 32 microversion: 2.1 time: 0.132159 Jul 12 16:23:28.017898 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 129/244] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:23:27 2022] POST /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:23:28.025360 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1743b337-6e78-4493-893d-9235e78e7b60 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1497 microversion: 2.1 time: 0.259649 Jul 12 16:23:28.027843 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:28.028756 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:28.043207 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:28.043912 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:28.045157 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:28.046123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:28.047438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 116/245] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:27 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:28.366915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:28.377036 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-98f11cfc-18ab-4634-9578-5c161f0efa7f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.354146 Jul 12 16:23:28.378427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 130/246] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:28 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:28.558672 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:28.559172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:28.565283 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:28.565737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:28.566505 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:28.566944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:28.595635 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:23:28.681333 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2b7b4f6a-212f-4d28-8104-b82cffb67593 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 204 len: 0 microversion: 2.1 time: 0.126179 Jul 12 16:23:28.682160 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 117/247] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:23:28 2022] DELETE /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:23:28.690587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:28.691903 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:28.702768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:28.703384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:28.704241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:28.704746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:29.018237 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:29.028105 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a38688af-682a-4fb5-aff6-6bbcecf7119b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1503 microversion: 2.1 time: 0.341603 Jul 12 16:23:29.029039 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 131/248] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:28 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:29.399933 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:29.400686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:29.407155 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:29.407693 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:29.408557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:29.409130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:29.559422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:29.570636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f339033b-4514-4dff-bff4-7d5c363b3bb5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.178828 Jul 12 16:23:29.571237 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 118/249] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:29 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:30.048048 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:30.049454 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:30.066718 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:30.067404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:30.068349 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:30.068970 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:30.408752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:30.416382 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f7c1708f-ae25-44bb-8d72-a66ff823b2ae tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1503 microversion: 2.1 time: 0.373411 Jul 12 16:23:30.416999 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 132/250] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:30 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1503 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:30.587692 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:30.588310 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:30.599612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:30.600394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:30.601375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:30.601964 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:30.633488 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:30.841507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:30.851063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1acffed1-9b35-4f31-b358-9ea0e8133ac6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.267340 Jul 12 16:23:30.851669 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 119/251] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:30 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:31.097450 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-2478d1cc-e241-484c-8104-ab8422a8521f req-64d05409-b326-4ce7-a081-f571478ffccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf12c4b-f23c-4461-93ca-c0a1d54043d5", "name": "network-vif-deleted", "tag": "b7a744e4-9b6c-441e-967a-06dc983801c7"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:31.110599 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-2478d1cc-e241-484c-8104-ab8422a8521f req-64d05409-b326-4ce7-a081-f571478ffccd service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.111345 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-2478d1cc-e241-484c-8104-ab8422a8521f req-64d05409-b326-4ce7-a081-f571478ffccd service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:31.129467 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-2478d1cc-e241-484c-8104-ab8422a8521f req-64d05409-b326-4ce7-a081-f571478ffccd service nova] Creating event network-vif-deleted:b7a744e4-9b6c-441e-967a-06dc983801c7 for instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 on hv-cinder-79760 Jul 12 16:23:31.138240 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-2478d1cc-e241-484c-8104-ab8422a8521f req-64d05409-b326-4ce7-a081-f571478ffccd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051054 Jul 12 16:23:31.140959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 133/252] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:31.175020 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5089db0e-f0ee-475f-b818-91e46298a8ab tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:31.175514 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5089db0e-f0ee-475f-b818-91e46298a8ab tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:31.184119 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5089db0e-f0ee-475f-b818-91e46298a8ab tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.185022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5089db0e-f0ee-475f-b818-91e46298a8ab tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:31.186017 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5089db0e-f0ee-475f-b818-91e46298a8ab tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.186619 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5089db0e-f0ee-475f-b818-91e46298a8ab tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:31.222153 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5089db0e-f0ee-475f-b818-91e46298a8ab tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/ips" status: 200 len: 150 microversion: 2.1 time: 0.050920 Jul 12 16:23:31.222974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 120/253] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:23:31 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:31.435474 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:31.436272 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:31.447894 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.450385 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:31.452416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.452864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:31.529311 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.532492 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:31.534172 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lazy-loading 'fault' on Instance uuid dbf12c4b-f23c-4461-93ca-c0a1d54043d5 {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:23:31.653217 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:31.666913 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9f19b74b-280c-4e22-9aca-fc7e7c024128 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 200 len: 1303 microversion: 2.1 time: 0.236736 Jul 12 16:23:31.667505 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 134/254] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:31 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 1303 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:31.869595 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:31.871460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:31.884410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.885000 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:31.889364 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:31.890884 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:32.089582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:32.097560 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5cfbfe84-003c-4fb1-946f-dbd9f613cdd1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.233268 Jul 12 16:23:32.098181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 121/255] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:31 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:32.685442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:32.686003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: dbf12c4b-f23c-4461-93ca-c0a1d54043d5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:32.692639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:32.693101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:32.693859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:32.694457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:32.709380 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] HTTP exception thrown: Instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 could not be found. Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Request method failure captured: Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 HTTP/1.1 Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ_uaUJN3Jf2qcC2hgK5a2OIIDQA4XzDZZu0aYXV5EKV7-0k8LkW0h1CjakpnPT3Z0SfSDU5Hyc42VvSitBocIxeb9r5okZzQ4qD_u4QRn4ryhrbI_-slq21Vd0ibo9hXlWUsmqBcbl-l71pBlDuNHfnGy0XhclxY0XEZ2QdlId3Hn8 Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 4c0e47ebace74e88b8b501586b5b501d Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesActionsTest-1419709866 Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:23:32.711358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c0e47ebace74e88b8b501586b5b501d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4c0e47ebace74e88b8b501586b5b501d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c0e47ebace74e88b8b501586b5b501d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4c0e47ebace74e88b8b501586b5b501d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesActionsTest-1419709866 Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 4c0e47ebace74e88b8b501586b5b501d Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesActionsTest-1419709866 Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesActionsTest-1419709866-project Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: afa10c2abc41408fb95a212bdb9049bc Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesActionsTest-1419709866-project Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 could not be found. Jul 12 16:23:32.712935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'dbf12c4b-f23c-4461-93ca-c0a1d54043d5'} Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 could not be found. Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:23:32.713785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 could not be found. Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 could not be found. Jul 12 16:23:32.715063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:23:32.716854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Returning 404 to user: Instance dbf12c4b-f23c-4461-93ca-c0a1d54043d5 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:23:32.717747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-401fdecc-237d-41fd-bfc8-29ba497443d7 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5" status: 404 len: 111 microversion: 2.1 time: 0.037943 Jul 12 16:23:32.718485 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 135/256] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:32 2022] GET /compute/v2.1/servers/dbf12c4b-f23c-4461-93ca-c0a1d54043d5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:23:32.816486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e26f3d0d-d066-4ce5-bcc1-724f1373e56d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8013ea4-d9ec-476e-aa89-f17d95c5d3bd"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:32.817673 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e26f3d0d-d066-4ce5-bcc1-724f1373e56d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:32.836427 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e26f3d0d-d066-4ce5-bcc1-724f1373e56d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:32.839887 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e26f3d0d-d066-4ce5-bcc1-724f1373e56d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:32.840730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e26f3d0d-d066-4ce5-bcc1-724f1373e56d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:32.843279 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e26f3d0d-d066-4ce5-bcc1-724f1373e56d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:32.859024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1646633915", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "networks": [{"uuid": "50b0be25-bbf0-44c2-8fb7-d8d8eb2dff5a"}]}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:33.193635 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e26f3d0d-d066-4ce5-bcc1-724f1373e56d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387174 Jul 12 16:23:33.200351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 122/257] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:23:32 2022] POST /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:33.205751 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:33.206752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:33.216170 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:33.217521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:33.219436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:33.220109 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:33.424536 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:33.432789 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a3a8d164-e09f-475f-b184-bc295049a3cd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.230919 Jul 12 16:23:33.433806 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 123/258] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:33 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:34.454203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:34.455530 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:34.461901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:34.462359 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:34.463304 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:34.464469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:34.631617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:34.644737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-beeb3344-9f9a-4437-97f0-98dd9e0a6391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.195189 Jul 12 16:23:34.645664 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 124/259] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:34 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:35.669071 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:35.670447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:35.677208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:35.677661 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:35.678423 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:35.678852 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:35.855968 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:35.869602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ee777a53-dac6-4562-bc4b-838d186fa23f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.204902 Jul 12 16:23:35.871103 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 125/260] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:35 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:35.877683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-192d7285-341c-454f-9a5f-08ee7718f53f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:35.878549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-192d7285-341c-454f-9a5f-08ee7718f53f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:35.889855 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-192d7285-341c-454f-9a5f-08ee7718f53f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:35.890714 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-192d7285-341c-454f-9a5f-08ee7718f53f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:35.892088 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-192d7285-341c-454f-9a5f-08ee7718f53f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:35.893281 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-192d7285-341c-454f-9a5f-08ee7718f53f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:35.932657 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-192d7285-341c-454f-9a5f-08ee7718f53f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/ips" status: 200 len: 149 microversion: 2.20 time: 0.060362 Jul 12 16:23:35.933269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 126/261] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jul 12 16:23:35 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:23:36.892575 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:36.894016 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:36.904511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:36.905324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:36.906296 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:36.906871 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:37.186001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:37.193535 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4684f130-b89f-4511-9f26-839b10cd88bc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.309270 Jul 12 16:23:37.194314 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 127/262] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:36 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:38.130246 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:38.137105 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:38.145750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:38.146555 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:38.147583 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:38.148237 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:38.185356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lazy-loading 'flavor' on Instance uuid c6459fa8-bfbc-40a1-af27-2d44bad65d98 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:23:39.869470 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] validate_networks() for [('50b0be25-bbf0-44c2-8fb7-d8d8eb2dff5a', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:23:40.143129 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6465e5e6-6924-434f-a554-0299a9f0d9c7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/action" status: 202 len: 0 microversion: 2.20 time: 2.022674 Jul 12 16:23:40.143819 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 128/263] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 16:23:38 2022] POST /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/action => generated 0 bytes in 2024 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:23:40.153313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:40.154433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:40.164904 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:40.166497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:40.170566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:40.172347 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:40.332087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:40.340610 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9e56e6bb-31bf-4a67-aa83-10b087335a06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.194801 Jul 12 16:23:40.341213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 129/264] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:40 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:40.364672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:23:40.365150 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:23:40.365822 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:23:40.366389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:23:40.366959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:23:40.378022 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:40.378854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:40.379814 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:40.380445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:40.399019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Getting quotas for project 4c0e47ebace74e88b8b501586b5b501d. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:23:40.404226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Getting quotas for user afa10c2abc41408fb95a212bdb9049bc and project 4c0e47ebace74e88b8b501586b5b501d. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:23:40.417493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:23:40.420264 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:23:40.469384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-80e0e4ee-6d19-4da3-be0c-16ddceb62b08 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.615401 Jul 12 16:23:40.474951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 136/265] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 7617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 16:23:40.479172 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-45924a2e-573d-49c8-b60d-a79113f1c245 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: .version_select at 0x7f1da5c2ba60>, body: {"keypair": {"name": "tempest-keypair-968719657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy8LNL9RuJUHDk29fxiI/eCbmgbP6iMfEKnL1QsjUyeZHvqSSxq2JRU3htm84CoC96mddPyvJs9Dmfy1iXlhX2/NygWK3jQ1xrRJR+WXItHjH3fzQHIIKzTYJiMGskV/w=="}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:40.494481 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-45924a2e-573d-49c8-b60d-a79113f1c245 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:23:40.504244 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-45924a2e-573d-49c8-b60d-a79113f1c245 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:23:40.550260 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-45924a2e-573d-49c8-b60d-a79113f1c245 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078522 Jul 12 16:23:40.551057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 137/266] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:23:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:40.571579 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:40.572312 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:40.587351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:40.587816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:40.589985 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:40.590437 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:40.600382 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8c85c755-3f7b-4a7c-a0e0-dddd3c09782b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Action: 'create', calling method: .version_select at 0x7f1da62c2280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1223961137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgX9usqAy9NDhG8ZLEjGpI9XHiAhIgEXvksjsPSo9aQq9p0NPTEHPUJDUOtANrCbh4ceKTk5rwuM0hOJMXTdfdKNpViPXYHI8Pfq5WkyiJa1Qn6nuJysTktmhsaVwkSVQ=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:40.663644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-8c85c755-3f7b-4a7c-a0e0-dddd3c09782b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:23:40.680402 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-8c85c755-3f7b-4a7c-a0e0-dddd3c09782b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for user a69aa7a2c98d4f30a5585c89e5295eb7 and project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:23:40.736537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8c85c755-3f7b-4a7c-a0e0-dddd3c09782b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.394297 Jul 12 16:23:40.737691 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 130/267] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:23:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:40.743058 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2481beb2-ba70-437f-9a0c-40632f8af329 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:40.748048 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2481beb2-ba70-437f-9a0c-40632f8af329 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:40.844818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:40.864493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:40.866601 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:40.867830 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5a5f4ce3-7a00-4158-bf42-6ec37d27d18d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.315622 Jul 12 16:23:40.868759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 138/268] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:40 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:40.904384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2481beb2-ba70-437f-9a0c-40632f8af329 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:40.919301 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2481beb2-ba70-437f-9a0c-40632f8af329 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1214 microversion: 2.1 time: 0.180068 Jul 12 16:23:40.919883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 131/269] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:40 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:41.362410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:41.362999 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:41.371627 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:41.372182 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:41.372960 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:41.373736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:41.590216 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:41.601081 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8a438162-18da-486b-ae2e-dd51fe77f0b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.246797 Jul 12 16:23:41.601876 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 139/270] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:41 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:41.887996 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:41.889298 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:41.906548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:41.908984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:41.911484 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:41.913025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:41.940709 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:41.941998 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:41.966204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:41.969638 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:41.970842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:41.972603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:42.153910 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:42.165338 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1388fba5-701e-4db8-a550-5df36076073d tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1272 microversion: 2.1 time: 0.231283 Jul 12 16:23:42.167736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 140/271] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:41 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:42.619414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:42.620718 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:42.622798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:42.631203 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:42.631935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:42.633292 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:42.634056 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:42.678136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:42.694140 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:42.696663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:42.698492 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-13f5d157-2955-431c-8ff7-5a4b70dae2eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.816024 Jul 12 16:23:42.699221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 132/272] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:41 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:42.811222 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:42.820080 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-76400f4b-aa65-4a7d-969c-593d6e12adca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.204687 Jul 12 16:23:42.820826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 141/273] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:42 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:43.114605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-43518826", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39"}], "security_groups": [{"name": "tempest-securitygroup--338609228"}], "key_name": "tempest-keypair-968719657", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:43.188886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:43.198518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:43.213263 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:43.227344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:43.228169 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:43.228601 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:43.384394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] validate_networks() for [('791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:23:43.404092 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:43.412628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f88d3cf8-c175-4d20-a752-e0238d71f4e3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.232643 Jul 12 16:23:43.413540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:43 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:43.719372 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:43.721295 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:43.728282 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:43.731521 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:43.735785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:43.736758 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:43.913432 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:43.924573 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:43.927274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:43.930512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c7486996-f1b8-400c-bd15-1250f74ab1c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.216565 Jul 12 16:23:43.943692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 143/275] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:43 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:43.949351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:43.950258 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:43.956903 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:43.957602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:43.958538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:43.959137 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:44.138333 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:44.143747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:44.151826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-794d051a-a493-4252-a84c-3794a710bcf9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.205421 Jul 12 16:23:44.153927 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 144/276] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:43 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:44.208836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:23:44.210172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:23:44.210855 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:23:44.221596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:23:44.225855 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:23:44.237560 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:44.238363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:44.240342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:44.241301 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:44.267744 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:23:44.275530 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:23:44.295792 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:23:44.298091 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:23:44.366905 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c35044d5-2090-4247-bfd3-2d3ad5a69666 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.256967 Jul 12 16:23:44.367864 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 133/277] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:23:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:23:44.379298 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fb9cc1ea-3ec2-44b9-bfdc-46a2bb03b93e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:44.380199 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fb9cc1ea-3ec2-44b9-bfdc-46a2bb03b93e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:44.433410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:44.434204 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:44.455435 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:44.457469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:44.458442 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:44.467773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:44.520692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fb9cc1ea-3ec2-44b9-bfdc-46a2bb03b93e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:44.528449 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fb9cc1ea-3ec2-44b9-bfdc-46a2bb03b93e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1239 microversion: 2.1 time: 0.154006 Jul 12 16:23:44.531049 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 145/278] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:44 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1239 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:44.581750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-483e454f-5f64-472d-9b3c-6fd51df473d4 req-5211b2ba-287a-4462-a32f-571fb82dbba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815cc7d5-7d94-44a3-9187-4e3f949463c2", "tag": "b4a64fc8-8e37-4843-8e60-fdb67cbb39ee"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:44.595126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-483e454f-5f64-472d-9b3c-6fd51df473d4 req-5211b2ba-287a-4462-a32f-571fb82dbba8 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:44.595772 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-483e454f-5f64-472d-9b3c-6fd51df473d4 req-5211b2ba-287a-4462-a32f-571fb82dbba8 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:44.612064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-483e454f-5f64-472d-9b3c-6fd51df473d4 req-5211b2ba-287a-4462-a32f-571fb82dbba8 service nova] Creating event network-changed:b4a64fc8-8e37-4843-8e60-fdb67cbb39ee for instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 on hv-cinder-79760 Jul 12 16:23:44.618472 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-483e454f-5f64-472d-9b3c-6fd51df473d4 req-5211b2ba-287a-4462-a32f-571fb82dbba8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040524 Jul 12 16:23:44.620069 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 146/279] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:44.806601 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:44.817332 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-009ee6f6-3fc2-48d1-bc78-c8bc7b1b6314 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.390929 Jul 12 16:23:44.817920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 134/280] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:44 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:44.954545 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:44.957643 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:44.969673 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:44.970220 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:44.971348 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:44.972516 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:45.148494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:45.156499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:45.158084 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:45.159241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7a484411-5b67-402d-a6b1-4ab411fd2338 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.211795 Jul 12 16:23:45.159793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 147/281] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:44 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:45.175501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:45.176112 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:45.183584 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:45.184036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:45.184815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:45.185292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:45.323825 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:45.331207 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:45.333892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ef840a4f-fb21-430a-98f9-b2188a7fa184 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.162175 Jul 12 16:23:45.334471 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 135/282] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:45 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:45.547052 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:45.547658 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:45.554157 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:45.554603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:45.555375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:45.555805 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:45.615626 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:45.623168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f5a380cc-1c99-4dff-9255-b58e912bc16d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1291 microversion: 2.1 time: 0.080042 Jul 12 16:23:45.623993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 148/283] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:45 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1291 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:45.834254 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:45.835382 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:45.843000 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:45.843451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:45.844217 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:45.844651 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:45.974004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:45.982303 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c2bba1f4-3c0f-4b48-b614-b1e8a814736a tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.152133 Jul 12 16:23:45.982888 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 136/284] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:45 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:46.178567 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:46.179168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:46.185074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:46.186249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:46.187449 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:46.187883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:46.319328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:46.328306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:46.330187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:46.331669 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ee73d880-3cb8-4ce3-9168-ba61df2ad2d7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.157445 Jul 12 16:23:46.332397 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 149/285] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:46 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:46.351073 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:46.351829 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:46.359099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:46.359553 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:46.360324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:46.360762 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:46.496540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:46.504335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a3532388-469e-46ba-81fb-8b203bfed61d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.157311 Jul 12 16:23:46.505437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 137/286] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:46 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:46.647243 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:46.648319 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:46.659109 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:46.659904 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:46.663065 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:46.663798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:46.980596 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:46.988823 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5d2008f0-2fa8-4bca-a12d-aa167d07b3c6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1299 microversion: 2.1 time: 0.351331 Jul 12 16:23:46.989553 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 150/287] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:46 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1299 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:46.999523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:47.000342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:47.006759 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:47.007431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:47.008347 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:47.008922 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:47.285923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:47.294994 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d20f7954-bf9f-456a-a622-b04b9fe97c5b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.299260 Jul 12 16:23:47.295787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 138/288] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:46 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:47.352445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:47.353132 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:47.364429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:47.365503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:47.368040 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:47.369070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:47.522002 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:47.523512 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:47.530285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:47.531046 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:47.532115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:47.532750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:47.620163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:47.632679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:47.634891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:47.637847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-137e1844-2751-49aa-b263-1e7f585b7867 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.289549 Jul 12 16:23:47.645306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 151/289] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:47 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:48.009088 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:48.010952 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:48.018863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:48.020118 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:48.021367 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:48.021811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:48.037528 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:48.047587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c498ada7-48aa-40f8-9e98-72cf21fa13bb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.529204 Jul 12 16:23:48.050599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 139/290] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:47 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:48.301968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:48.314692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e0efae13-ff62-41d6-81fa-b984990eca18 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.310888 Jul 12 16:23:48.315101 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:48.315840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:48.316165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 152/291] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:48 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:48.331583 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:48.332215 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:48.333269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:48.333895 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:48.601566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:48.609990 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b2566097-25d6-4192-8f3c-3d17c4d166e0 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.300590 Jul 12 16:23:48.611026 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 140/292] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:48 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:48.657854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:48.658612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:48.675917 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:48.676671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:48.678262 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:48.678871 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:48.832268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-6ba14a5a-f10d-4565-a35b-bcc813637e0a req-1f1da1a1-47a0-46c2-a24f-bc4d9e904187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4e4cb1-5677-4912-80a3-18b65ae45b20", "tag": "b4434c94-2bb5-4c14-b51e-bafabf825dbf"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:48.867496 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-6ba14a5a-f10d-4565-a35b-bcc813637e0a req-1f1da1a1-47a0-46c2-a24f-bc4d9e904187 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:48.870460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-6ba14a5a-f10d-4565-a35b-bcc813637e0a req-1f1da1a1-47a0-46c2-a24f-bc4d9e904187 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:48.890535 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-6ba14a5a-f10d-4565-a35b-bcc813637e0a req-1f1da1a1-47a0-46c2-a24f-bc4d9e904187 service nova] Creating event network-changed:b4434c94-2bb5-4c14-b51e-bafabf825dbf for instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 on hv-cinder-79760 Jul 12 16:23:48.897796 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-6ba14a5a-f10d-4565-a35b-bcc813637e0a req-1f1da1a1-47a0-46c2-a24f-bc4d9e904187 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068964 Jul 12 16:23:48.899149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 141/293] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:49.025187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:49.034956 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:49.036612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:49.037802 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8c5d760e-b520-412f-85bd-86e0c0e39f14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.385059 Jul 12 16:23:49.038679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 153/294] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:48 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:49.070939 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:49.071921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:49.083991 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:49.086336 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:49.087149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:49.087584 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:49.282078 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:49.292348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6822acdd-a4d2-4a35-9df6-a9610c6f65d4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.227188 Jul 12 16:23:49.298934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 142/295] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:49 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:49.332591 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:49.334188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:49.342032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:49.343440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:49.344738 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:49.345466 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:49.583268 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:49.590703 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-160217d3-0ec0-480e-b1cb-5117cbbf1efb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.262542 Jul 12 16:23:49.591274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 154/296] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:49 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:49.627469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:49.628073 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:49.634549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:49.634994 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:49.635756 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:49.636184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:49.769089 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:49.776556 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bb0ce25c-3e1d-402d-8a2f-08b97104d4b1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.152903 Jul 12 16:23:49.777156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 143/297] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:49 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:50.056123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:50.056731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:50.062771 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.063221 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.063981 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.064422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.194081 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:50.203321 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:50.204849 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:50.206049 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3167c48b-2929-42d7-aa07-d59d372546d0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.153911 Jul 12 16:23:50.206606 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 155/298] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:50 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:50.315573 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:50.316317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:50.318392 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:50.324460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.325136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.326198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.326824 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.460069 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:50.468215 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9f78a456-21c0-4ed9-8382-161dd8f644a0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.156531 Jul 12 16:23:50.468923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 144/299] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:50 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:50.608218 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:50.608747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:50.610724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:50.616481 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.616926 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.617712 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.618154 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.750960 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:50.758265 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-af5e7523-582d-4aba-b53d-924cf08690b4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.154599 Jul 12 16:23:50.758851 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 156/300] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:50 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:50.793735 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:50.794351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:50.800760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.801256 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.802018 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:50.802460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:50.931376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:50.938694 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-75d3ebe6-8098-47ef-b0ad-33422175d957 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.149382 Jul 12 16:23:50.939255 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 145/301] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:50 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:51.224937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:51.225582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:51.232090 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.232542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:51.233331 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.233766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:51.365555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:51.373482 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:51.375032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:51.376179 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5d13c78d-7129-40d4-9904-38febbcb0dcf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.155140 Jul 12 16:23:51.376726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 157/302] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:51 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:51.486050 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:51.486630 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:51.493143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.493599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:51.494364 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.494804 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:51.626810 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:51.634197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0acefd22-a9c2-4ae9-a074-2e10aebf9619 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.152445 Jul 12 16:23:51.634765 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 146/303] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:51 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:51.774528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:51.775048 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:51.781539 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.781976 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:51.782723 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.783152 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:51.905433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:51.912677 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0d64b647-0b00-4bb8-a7bb-700e865439ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.142057 Jul 12 16:23:51.913266 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 158/304] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:51 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:51.955615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:51.956223 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:51.964093 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.964543 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:51.965418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:51.965857 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.095761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:52.103069 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6a1737fd-2449-4236-abe7-f0234fc0dadf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.151313 Jul 12 16:23:52.103633 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 147/305] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:51 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:52.394252 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:52.394876 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:52.400827 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:52.401847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.402630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:52.403235 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.536645 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:52.544422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:52.545957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:52.547094 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-060f2733-bd20-426f-b110-0868443d81dd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.156775 Jul 12 16:23:52.547646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 159/306] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:52 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:52.652092 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:52.652696 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:52.658720 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:52.659166 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.659936 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:52.660374 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.785624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:52.793003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-31b539e4-6681-452b-9cb1-269313ff6211 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.145320 Jul 12 16:23:52.793620 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 148/307] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:52 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:52.929353 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:52.929968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:52.936672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:52.937092 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.937880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:52.938305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.948911 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-a17d1a72-df7f-4678-ba53-825c5c02e397 req-220bcb94-43fc-4bf1-9bec-bcd2199dfd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815cc7d5-7d94-44a3-9187-4e3f949463c2", "name": "network-vif-plugged", "status": "completed", "tag": "b4a64fc8-8e37-4843-8e60-fdb67cbb39ee"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:52.958157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-a17d1a72-df7f-4678-ba53-825c5c02e397 req-220bcb94-43fc-4bf1-9bec-bcd2199dfd54 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:52.958851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-a17d1a72-df7f-4678-ba53-825c5c02e397 req-220bcb94-43fc-4bf1-9bec-bcd2199dfd54 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:52.972011 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-a17d1a72-df7f-4678-ba53-825c5c02e397 req-220bcb94-43fc-4bf1-9bec-bcd2199dfd54 service nova] Creating event network-vif-plugged:b4a64fc8-8e37-4843-8e60-fdb67cbb39ee for instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 on hv-cinder-79760 Jul 12 16:23:52.976735 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-a17d1a72-df7f-4678-ba53-825c5c02e397 req-220bcb94-43fc-4bf1-9bec-bcd2199dfd54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031676 Jul 12 16:23:52.977367 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 149/308] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:23:53.070630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:53.078917 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ee5b64c6-92d2-4b8b-84a3-90e8e3b455e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.153529 Jul 12 16:23:53.079473 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 160/309] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:52 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:53.120751 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:53.121952 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:53.128118 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:53.128561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:53.129363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:53.129796 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:53.257974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:53.265237 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4e43f0b0-b92e-4329-a04d-7c7dd678a4d1 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.149053 Jul 12 16:23:53.265799 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 150/310] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:53 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:53.565117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:53.565732 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:53.571665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:53.572110 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:53.572863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:53.573329 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:53.697950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:53.705751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:53.707257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:53.708394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fa3c855b-44a8-4663-b65f-2d779b4006fc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.147153 Jul 12 16:23:53.708943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 161/311] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:53 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:53.815928 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:53.816711 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:53.823253 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:53.823702 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:53.826498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:53.826498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:53.951119 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:53.958539 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-726be8f9-c64b-477f-a772-0a647a83cf0e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.146419 Jul 12 16:23:53.959126 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 151/312] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:53 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:54.096745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:54.097409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:54.104163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.104617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:54.105436 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.105875 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:54.240672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:54.249176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c26b36c5-4613-4a4d-9848-6cfbbcea2faa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.156616 Jul 12 16:23:54.249770 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 162/313] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:54 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:54.281742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:54.282362 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:54.284733 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:54.289912 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=12 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:54.291728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.292181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:54.292952 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.293422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:54.429625 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:54.437619 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4bbb4c05-39fe-4e5d-abb9-d553d2d3c685 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.159992 Jul 12 16:23:54.438185 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 152/314] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:54 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:54.727099 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:54.727865 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:54.729805 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=12 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:54.735924 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.736377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:54.737423 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.737842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:54.743589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:54.898403 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:54.909255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:54.914058 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:54.915530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b4b65d19-805d-4f50-9137-d545e34a83c5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.192593 Jul 12 16:23:54.916151 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 163/315] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:54 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:54.976080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:54.976815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:54.984021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.984847 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:54.985813 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:54.986400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:55.187079 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:55.191378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:55.196307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3469bafd-5a38-418c-bda6-dc84b195bfde tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.224346 Jul 12 16:23:55.196867 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 153/316] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:54 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:55.265862 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:55.266392 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:55.272378 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:55.272852 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:55.273656 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:55.274090 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:55.409500 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:55.417103 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3538ec8c-d485-4643-8fbf-96bb23e56805 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.155079 Jul 12 16:23:55.417670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 164/317] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:55 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:55.455535 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:55.456238 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:55.463144 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:55.463590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:55.464348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:55.464780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:55.607814 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:55.616997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5d97d1a3-9721-44e9-94e6-a0e90822c8bf tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1314 microversion: 2.1 time: 0.165555 Jul 12 16:23:55.618244 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 154/318] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:55 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:55.935238 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:55.935919 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:55.942634 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:55.943088 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:55.943853 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:55.944290 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.075371 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:56.083199 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:56.084716 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:56.085884 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a8321f5c-f51a-4cf9-9761-4d3e54b3732d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.155979 Jul 12 16:23:56.086444 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 165/319] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:55 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:56.213828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:56.214434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:56.220326 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:56.220770 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.221634 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:56.222064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.366035 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:56.374483 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e46cc4fc-65e2-42d3-ac21-2e25a205c1b2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.164390 Jul 12 16:23:56.375044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 155/320] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:56 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:56.437019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:56.439389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:56.460116 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:56.460869 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.462013 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:56.462695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.610666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:56.618192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fd9a1119-626d-4976-8fa9-97dc391660f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.188135 Jul 12 16:23:56.618749 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 166/321] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:56 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:56.634138 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:56.634739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:56.641153 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:56.641599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.642343 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:56.642775 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.784555 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:56.791936 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8b09bc56-6542-4e22-a9ed-2503eee2d046 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1498 microversion: 2.1 time: 0.161527 Jul 12 16:23:56.792570 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 156/322] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:56 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:56.954430 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-2a06bbcf-f76d-4097-bde8-72eabb9fcdf1 req-940b6d41-4ed6-4f90-9e9a-bcecfb067efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4e4cb1-5677-4912-80a3-18b65ae45b20", "name": "network-vif-plugged", "status": "completed", "tag": "b4434c94-2bb5-4c14-b51e-bafabf825dbf"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:23:56.973438 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-2a06bbcf-f76d-4097-bde8-72eabb9fcdf1 req-940b6d41-4ed6-4f90-9e9a-bcecfb067efc service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:56.976297 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-2a06bbcf-f76d-4097-bde8-72eabb9fcdf1 req-940b6d41-4ed6-4f90-9e9a-bcecfb067efc service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:56.993668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-2a06bbcf-f76d-4097-bde8-72eabb9fcdf1 req-940b6d41-4ed6-4f90-9e9a-bcecfb067efc service nova] Creating event network-vif-plugged:b4434c94-2bb5-4c14-b51e-bafabf825dbf for instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 on hv-cinder-79760 Jul 12 16:23:57.008744 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-2a06bbcf-f76d-4097-bde8-72eabb9fcdf1 req-940b6d41-4ed6-4f90-9e9a-bcecfb067efc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059887 Jul 12 16:23:57.015000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 167/323] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:23:57.106044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:57.106878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:57.127759 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.129861 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.129861 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.129861 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.290683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:57.308524 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:57.314918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:57.316552 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6662159e-bdb5-4f20-987a-69fc0b48bace tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.216137 Jul 12 16:23:57.317752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 157/324] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:57 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:57.379281 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:57.379951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:57.386072 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.386524 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.387910 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.388348 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.393334 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:57.393948 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:57.400014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.400507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.401313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.401836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.415432 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:23:57.495737 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e0a89674-cae7-4bc0-b4f3-d7611d7d8d6b tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 204 len: 0 microversion: 2.1 time: 0.120795 Jul 12 16:23:57.499921 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 168/325] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:23:57 2022] DELETE /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:23:57.506058 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:57.506767 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:57.513958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.514409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.515183 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.515745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.561098 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:57.568993 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4cac5378-3978-452c-9ccb-96b6c543a904 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.179772 Jul 12 16:23:57.570337 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 158/326] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:57 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:57.635227 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:57.635883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:57.643067 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.643614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.644551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:57.645100 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:57.662505 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:57.670710 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fd4dfcce-d204-4bd3-bcd4-ad7ca6278689 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1504 microversion: 2.1 time: 0.168818 Jul 12 16:23:57.671346 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 169/327] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:57 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:57.783990 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:57.791308 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0263cea7-addd-4b8a-b075-e3a6f0b1b0d6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.160081 Jul 12 16:23:57.791875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 159/328] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:57 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:58.335430 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:58.336028 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:58.342547 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.342987 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.343737 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.344165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.478336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:58.486233 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:58.487743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:58.489173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-044f5b56-16f8-4221-9bf0-a1536e98e77a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.157635 Jul 12 16:23:58.489724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 170/329] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:58 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:58.587255 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:58.587958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:58.597806 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.598408 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.599408 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.599809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.687583 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:58.688280 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:58.694738 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.695261 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.696116 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.696627 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.732290 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:58.740374 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-49d5f5f6-4b9e-4aca-b01b-cbbdd800ff66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.157202 Jul 12 16:23:58.741330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 160/330] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:58 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:58.816463 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:58.817096 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:58.823080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.823525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.824284 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:58.824787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:58.845571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:58.852501 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-919ff184-0872-45ae-b045-c72413dcc8ed tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1504 microversion: 2.1 time: 0.168702 Jul 12 16:23:58.853484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 171/331] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:58 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:58.963179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:58.971232 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e41ff684-ea71-4964-9eba-2d17dfe7178b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.158574 Jul 12 16:23:58.971804 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 161/332] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:58 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:23:59.509604 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:59.509604 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:59.515078 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.515536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:59.516314 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.516746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:59.645279 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:59.653318 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:59.654839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:59.656000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-af3fa860-84be-4f0d-90a6-d1e8e9e579d9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.152813 Jul 12 16:23:59.656552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 172/333] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:23:59 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:23:59.758262 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:59.758877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:59.766126 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.766581 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:59.767366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.767805 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:59.869894 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:59.870588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:59.877931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.878455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:59.879640 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.880906 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:59.906526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:23:59.914227 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e4d0a8ac-a1ed-43a3-b851-15f3aaa665ca tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.159817 Jul 12 16:23:59.914812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 162/334] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:59 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:23:59.989390 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:23:59.990015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:23:59.997209 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.997603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:23:59.998387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:23:59.998813 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:00.025520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:00.033113 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ea9eaea2-2f3a-4013-8c67-932fa0ce2179 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1504 microversion: 2.1 time: 0.167000 Jul 12 16:24:00.033674 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 173/335] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:59 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:00.131329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:00.138763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-80256313-675a-4b7b-8124-f17aefd0ef61 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.153631 Jul 12 16:24:00.139330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 163/336] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:23:59 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:00.674291 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:00.674893 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:00.680879 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:00.681360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:00.682115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:00.682550 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:00.814696 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:00.823142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:00.825538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:00.826711 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f5f18524-62e9-4ae6-9501-48cf7bc7f457 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.156333 Jul 12 16:24:00.827272 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 174/337] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:00 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:00.931490 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:00.932099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:00.938578 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:00.939021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:00.939774 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:00.940205 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:01.054182 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:01.054182 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:01.057620 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:01.058067 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:01.059379 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:01.060384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:01.070781 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:01.078980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c95fd141-0e68-4992-b402-85921a38776e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.151361 Jul 12 16:24:01.079548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 164/338] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:00 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:01.156482 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:01.157572 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:01.163921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:01.164505 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:01.165523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:01.166064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:01.193482 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:01.202466 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-82725e0f-5e77-4c80-85bf-29b27ed4c580 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1504 microversion: 2.1 time: 0.155873 Jul 12 16:24:01.203150 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 175/339] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:01 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:01.300581 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:01.307970 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a592d41b-3c8e-4918-8908-d8d59dc2161e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.156133 Jul 12 16:24:01.308521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 165/340] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:01 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:01.844630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:01.845437 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:01.851616 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:01.852127 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:01.852885 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:01.853332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.052276 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:02.061717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:02.063481 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:02.078818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fcf30d60-b970-4383-b47f-2efe2c173660 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1742 microversion: 2.20 time: 0.238557 Jul 12 16:24:02.080423 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 176/341] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:01 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:02.097218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:02.097606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:02.105436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:02.107262 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.108608 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:02.109265 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.180951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-67728158-b5f1-43a8-bb0e-5e8fdb82401e req-ac09c17d-54ca-42c2-aa8a-7587646faf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815cc7d5-7d94-44a3-9187-4e3f949463c2", "name": "network-vif-deleted", "tag": "b4a64fc8-8e37-4843-8e60-fdb67cbb39ee"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:02.189629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-67728158-b5f1-43a8-bb0e-5e8fdb82401e req-ac09c17d-54ca-42c2-aa8a-7587646faf3a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:02.190069 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-67728158-b5f1-43a8-bb0e-5e8fdb82401e req-ac09c17d-54ca-42c2-aa8a-7587646faf3a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.203950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-67728158-b5f1-43a8-bb0e-5e8fdb82401e req-ac09c17d-54ca-42c2-aa8a-7587646faf3a service nova] Creating event network-vif-deleted:b4a64fc8-8e37-4843-8e60-fdb67cbb39ee for instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 on hv-cinder-79760 Jul 12 16:24:02.209140 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-67728158-b5f1-43a8-bb0e-5e8fdb82401e req-ac09c17d-54ca-42c2-aa8a-7587646faf3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Jul 12 16:24:02.209964 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 177/342] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:24:02.220782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:02.221572 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:02.228115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:02.228969 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.229347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:02.229785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.267505 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:02.275466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5fe25c6a-7bd9-47a8-bb88-9ebbba4f86d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.182347 Jul 12 16:24:02.276043 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 166/343] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:02 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:02.292874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:02.300459 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-60381eb6-9550-4fb1-ab78-3fdc682a5d00 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1462 microversion: 2.1 time: 0.083989 Jul 12 16:24:02.301012 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 178/344] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:02 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:02.324531 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:02.325662 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:02.331609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:02.332057 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.332825 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:02.333297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:02.462300 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:02.470683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8907a9c5-ecf8-4283-970e-9613f6d654fd tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1364 microversion: 2.1 time: 0.150077 Jul 12 16:24:02.471246 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 167/345] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:02 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:03.097245 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:03.097858 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:03.106281 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.106750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.107516 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.107948 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.129018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:03.252310 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:03.260066 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:03.261773 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:03.262986 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5c77efb1-042b-456f-a81f-8d317be9f763 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1742 microversion: 2.20 time: 0.169771 Jul 12 16:24:03.263715 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 179/346] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:03 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:03.294221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:03.295732 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:03.303763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.304220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.305953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.306399 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.323051 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:03.326884 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:03.334606 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.335685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.336524 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.336959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.370554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.371003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.371495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lazy-loading 'fault' on Instance uuid 815cc7d5-7d94-44a3-9187-4e3f949463c2 {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:24:03.412877 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa10c2abc41408fb95a212bdb9049bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e47ebace74e88b8b501586b5b501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:03.421352 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d32bfcde-09bd-4c6c-9f5b-d469a1a659a3 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 200 len: 1304 microversion: 2.1 time: 0.105075 Jul 12 16:24:03.421923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 180/347] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:03 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:03.459045 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:03.469570 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bd4aadf6-6130-47aa-8ab2-017825bc45da tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.180423 Jul 12 16:24:03.470176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 168/348] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:03 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:03.488044 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:03.489001 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:03.495484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.495928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.496716 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.497250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.647187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:03.656092 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2c9310a6-8f62-40e8-87a5-946eac86e08b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1554 microversion: 2.1 time: 0.172131 Jul 12 16:24:03.656665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 181/349] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:03 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:03.673276 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-42085e84-04f8-454b-991a-393d21c43e60 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:03.673777 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-42085e84-04f8-454b-991a-393d21c43e60 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:03.679940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42085e84-04f8-454b-991a-393d21c43e60 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.680397 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42085e84-04f8-454b-991a-393d21c43e60 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.681225 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42085e84-04f8-454b-991a-393d21c43e60 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:03.681669 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42085e84-04f8-454b-991a-393d21c43e60 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:03.761130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-42085e84-04f8-454b-991a-393d21c43e60 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090798 Jul 12 16:24:03.762641 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 169/350] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:24:03 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:04.280990 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:04.281635 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:04.288131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:04.288587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:04.289404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:04.289845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:04.437820 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:04.441489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:04.443434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] [instance: 815cc7d5-7d94-44a3-9187-4e3f949463c2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:04.451027 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:04.452507 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:04.453714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3e4dd6dc-b3a2-4714-a54d-70a5e67ceb78 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1742 microversion: 2.20 time: 0.176662 Jul 12 16:24:04.455313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:04.456370 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:04.457487 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:04.458611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:04.459925 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 182/351] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:04 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:04.476878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] HTTP exception thrown: Instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 could not be found. Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Request method failure captured: Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 HTTP/1.1 Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ_uaUJN3Jf2qcC2hgK5a2OIIDQA4XzDZZu0aYXV5EKV7-0k8LkW0h1CjakpnPT3Z0SfSDU5Hyc42VvSitBocIxeb9r5okZzQ4qD_u4QRn4ryhrbI_-slq21Vd0ibo9hXlWUsmqBcbl-l71pBlDuNHfnGy0XhclxY0XEZ2QdlId3Hn8 Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 4c0e47ebace74e88b8b501586b5b501d Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesActionsTest-1419709866 Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:24:04.478957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c0e47ebace74e88b8b501586b5b501d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4c0e47ebace74e88b8b501586b5b501d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c0e47ebace74e88b8b501586b5b501d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4c0e47ebace74e88b8b501586b5b501d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesActionsTest-1419709866 Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 4c0e47ebace74e88b8b501586b5b501d Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesActionsTest-1419709866 Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesActionsTest-1419709866-project Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: afa10c2abc41408fb95a212bdb9049bc Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesActionsTest-1419709866-project Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 could not be found. Jul 12 16:24:04.480292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '815cc7d5-7d94-44a3-9187-4e3f949463c2'} Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 could not be found. Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:24:04.482355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 could not be found. Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 could not be found. Jul 12 16:24:04.483603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:04.484675 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] Returning 404 to user: Instance 815cc7d5-7d94-44a3-9187-4e3f949463c2 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:24:04.484675 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b9f62b95-d2d8-4487-a89d-f2b6f8126138 tempest-VolumesActionsTest-1419709866 tempest-VolumesActionsTest-1419709866-project] 10.222.0.20 "GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2" status: 404 len: 111 microversion: 2.1 time: 0.044766 Jul 12 16:24:04.484930 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 170/352] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:04 2022] GET /compute/v2.1/servers/815cc7d5-7d94-44a3-9187-4e3f949463c2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:24:04.491047 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:04.491855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:04.509379 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:04.510146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:04.511274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:04.511943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:04.687049 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:04.696735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-28e50ab7-6f48-4142-bf85-0d9b09de43c0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.209971 Jul 12 16:24:04.697428 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 183/353] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:04 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:04.781680 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-234b6c03-fbf5-48c1-8b8e-f29d2277327b req-be9d0c2f-a85a-46e2-862e-454e13192cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4e4cb1-5677-4912-80a3-18b65ae45b20", "tag": "b4434c94-2bb5-4c14-b51e-bafabf825dbf"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:04.791243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-234b6c03-fbf5-48c1-8b8e-f29d2277327b req-be9d0c2f-a85a-46e2-862e-454e13192cab service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:04.791692 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-234b6c03-fbf5-48c1-8b8e-f29d2277327b req-be9d0c2f-a85a-46e2-862e-454e13192cab service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:04.810645 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-234b6c03-fbf5-48c1-8b8e-f29d2277327b req-be9d0c2f-a85a-46e2-862e-454e13192cab service nova] Creating event network-changed:b4434c94-2bb5-4c14-b51e-bafabf825dbf for instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 on hv-cinder-79760 Jul 12 16:24:04.817896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-234b6c03-fbf5-48c1-8b8e-f29d2277327b req-be9d0c2f-a85a-46e2-862e-454e13192cab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040947 Jul 12 16:24:04.821366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 171/354] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:05.394040 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-8b14fed5-fb01-4666-b8bf-d6dab4be1c41 req-043d8351-a239-4d0a-ba56-406046cc5418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6459fa8-bfbc-40a1-af27-2d44bad65d98", "name": "network-vif-plugged", "status": "completed", "tag": "2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:05.407482 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8b14fed5-fb01-4666-b8bf-d6dab4be1c41 req-043d8351-a239-4d0a-ba56-406046cc5418 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:05.408809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8b14fed5-fb01-4666-b8bf-d6dab4be1c41 req-043d8351-a239-4d0a-ba56-406046cc5418 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:05.442748 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-8b14fed5-fb01-4666-b8bf-d6dab4be1c41 req-043d8351-a239-4d0a-ba56-406046cc5418 service nova] Creating event network-vif-plugged:2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4 for instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 on hv-cinder-79760 Jul 12 16:24:05.453151 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-8b14fed5-fb01-4666-b8bf-d6dab4be1c41 req-043d8351-a239-4d0a-ba56-406046cc5418 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063570 Jul 12 16:24:05.454806 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 184/355] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:05.475776 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:05.478221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:05.498387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:05.500227 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:05.502918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:05.503549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:05.521198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:05.703083 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:05.716577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:05.717658 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:05.717971 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:05.718534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:05.722347 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0b546d7e-bc79-4b0f-a255-c08ef301d5a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1742 microversion: 2.20 time: 0.251324 Jul 12 16:24:05.724131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 172/356] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:05 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1742 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:05.727804 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:05.728209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:05.728985 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:05.729551 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:05.894415 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:05.902164 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cadfdca6-03da-46d1-97ba-07ac34f7d570 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1501 microversion: 2.1 time: 0.191328 Jul 12 16:24:05.905793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 185/357] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:05 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:05.922869 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26a9ab32-c202-4202-b441-cc30bda3c86f"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:05.924089 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:05.936670 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:05.938071 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:05.938879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:05.941429 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:05.977034 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] HTTP exception thrown: Cannot 'attach_volume' instance 97836b86-898a-44df-a529-4ebf4089cdbd while it is in vm_state rescued Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Request method failure captured: Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: POST /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd/os-volume_attachments HTTP/1.1 Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 74 Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-m9H521Lwot7C4VNMRpEa_HUy-NTX4_b9y9l4PuZqmXLZcsqAcUQ7bUOxpW-oJ1ajmPFEx6GutFRwqjlevwHRXxsSy4gOu7W-XULrDyEP1Pp9N6W7sXsyolvNC1rEUUf2Ck_xXjAgGHAR-EVynuAvnUFGyUaD0j3ZJVxbqHFT67xM Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:24:05.978836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_641dd5eac4cf4352924c1610407bc5e3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: e980def45e934114a2f0bc7081ffe8e3 Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {"volumeAttachment": {"volumeId": "26a9ab32-c202-4202-b441-cc30bda3c86f"}} Jul 12 16:24:05.980014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Cannot 'attach_volume' instance 97836b86-898a-44df-a529-4ebf4089cdbd while it is in vm_state rescued Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'server_id': '97836b86-898a-44df-a529-4ebf4089cdbd', 'body': {'volumeAttachment': {'volumeId': '26a9ab32-c202-4202-b441-cc30bda3c86f'}}} Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97836b86-898a-44df-a529-4ebf4089cdbd in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:24:05.984937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 97836b86-898a-44df-a529-4ebf4089cdbd while it is in vm_state rescued Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:24:05.986120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:24:05.987176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:24:05.987176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:24:05.987176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 97836b86-898a-44df-a529-4ebf4089cdbd while it is in vm_state rescued Jul 12 16:24:05.987176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:24:05.987176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Returning 409 to user: Cannot 'attach_volume' instance 97836b86-898a-44df-a529-4ebf4089cdbd while it is in vm_state rescued {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:24:05.987176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4793ea39-3c66-4fa7-8f4c-6989bf65d50a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063165 Jul 12 16:24:05.987176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 173/358] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:24:05 2022] POST /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 16:24:05.990002 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-722fd990-87d4-4914-9095-2e7eec3810b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:05.990537 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-722fd990-87d4-4914-9095-2e7eec3810b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:05.999841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:06.001325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-722fd990-87d4-4914-9095-2e7eec3810b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:06.002341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-722fd990-87d4-4914-9095-2e7eec3810b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:06.003223 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-722fd990-87d4-4914-9095-2e7eec3810b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:06.003667 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-722fd990-87d4-4914-9095-2e7eec3810b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:06.098970 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-722fd990-87d4-4914-9095-2e7eec3810b0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd/action" status: 202 len: 0 microversion: 2.1 time: 0.112781 Jul 12 16:24:06.099598 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 186/359] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:24:05 2022] POST /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:24:06.109596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:06.110204 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:06.117041 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:06.121176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:06.122685 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:06.123132 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:06.339004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:06.348430 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9b5730a6-13aa-4d15-8032-5b877bd7ca34 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.244408 Jul 12 16:24:06.349014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 174/360] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:06 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:06.569225 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-439485424", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1223961137", "security_groups": [{"name": "tempest-secgroup-smoke-2089313887"}], "block_device_mapping_v2": [{"uuid": "06c9bf2c-c07c-40c3-a572-0eee128bca3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e6199c1-7cb0-42ae-9742-827022684fbe"}]}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:06.696850 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] validate_networks() for [('0e6199c1-7cb0-42ae-9742-827022684fbe', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:24:06.743566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:06.745338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:06.755218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:06.756038 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:06.757167 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:06.757945 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:07.009125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:07.017552 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:07.019307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:07.020612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-831a94dd-c150-4cbe-be1d-cad73654aae0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1742 microversion: 2.20 time: 0.282725 Jul 12 16:24:07.031875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 175/361] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:06 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1742 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:07.080979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:24:07.081431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:24:07.081914 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:24:07.082347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:24:07.082753 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:24:07.094315 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:07.094738 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:07.095523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:07.095966 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:07.113541 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:24:07.117959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for user a69aa7a2c98d4f30a5585c89e5295eb7 and project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:24:07.181613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:24:07.184223 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06c9bf2c-c07c-40c3-a572-0eee128bca3b',volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:24:07.331499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-275c6f5a-3792-45bb-9382-da7a99d9b34e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766390 Jul 12 16:24:07.332932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 187/362] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:24:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:24:07.342918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-23e31238-6d62-4458-9c48-13bbc50feaa5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:07.343557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-23e31238-6d62-4458-9c48-13bbc50feaa5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:07.365663 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:07.366341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:07.375261 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:07.375925 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:07.376992 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:07.377979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:07.655336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:07.664011 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-329ed22c-085d-473a-8969-30c9c8463143 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.302671 Jul 12 16:24:07.676344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 188/363] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:07 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:07.727408 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-23e31238-6d62-4458-9c48-13bbc50feaa5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:07.738904 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-23e31238-6d62-4458-9c48-13bbc50feaa5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1094 microversion: 2.1 time: 0.397844 Jul 12 16:24:07.740314 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 176/364] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:07 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1094 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:08.039263 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:08.039921 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:08.046576 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:08.047030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:08.047789 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:08.048385 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:08.224447 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:08.232745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:08.234290 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:08.235438 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c8946c20-0f15-4fc4-921d-faad502aeb92 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1742 microversion: 2.20 time: 0.200017 Jul 12 16:24:08.236282 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 189/365] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:08 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:08.681588 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:08.682197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:08.688897 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:08.689365 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:08.690126 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:08.690558 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:08.758013 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:08.758801 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:08.765163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:08.765621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:08.766557 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:08.766987 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:08.822436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:08.828923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:08.830642 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cac6b456-47a3-47a7-96cd-1e13ae29f051 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.153331 Jul 12 16:24:08.831295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 177/366] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:08 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:08.837463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-56edc7bc-62a8-4cc3-bec6-c0fe97da486c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1144 microversion: 2.1 time: 0.083472 Jul 12 16:24:08.838018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 190/367] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:08 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:09.254131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:09.254760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:09.260729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:09.261220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:09.261977 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:09.262415 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:09.391389 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:09.399230 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:09.400732 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:09.401901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-441762ef-2d3a-4e1c-b816-e91e7a47b41d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1742 microversion: 2.20 time: 0.151762 Jul 12 16:24:09.402938 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 178/368] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:09 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:09.807136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1452258423", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "networks": [{"uuid": "56fddaac-aea1-4420-bca9-5159944baa07"}]}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:09.848219 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:09.848763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:09.865258 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:09.865709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:09.866485 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:09.866907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:09.917116 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] validate_networks() for [('56fddaac-aea1-4420-bca9-5159944baa07', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:24:10.258717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:10.271607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-121a61e7-f1f9-4c58-b886-0f7be58d8296 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.424495 Jul 12 16:24:10.272957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 179/369] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:09 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:10.279383 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:10.281150 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:10.297211 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:10.299663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:10.301818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:10.302417 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:10.410021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:10.428529 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ce5db7ff-5360-4094-9951-1c187dae75cb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1210 microversion: 2.1 time: 0.153038 Jul 12 16:24:10.430023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 180/370] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:10 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:10.454283 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:10.458741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:10.473497 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:24:10.473914 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:24:10.474350 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:24:10.474817 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:10.475014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:24:10.475280 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:24:10.476428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:10.477808 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:10.478616 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:10.492940 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:10.498556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:10.501938 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:10.506909 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:10.558579 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Getting quotas for project 16d93a63cf174aa9b006723dd55a523c. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:24:10.584813 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Getting quotas for user a9d0db5db4e647c8ae5edef6c435923c and project 16d93a63cf174aa9b006723dd55a523c. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:24:10.610783 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:24:10.616526 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:24:10.719759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-610cca21-f195-46d4-9c81-d9ffa8976d7e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916321 Jul 12 16:24:10.724111 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 191/371] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:24:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:24:10.734451 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8bec66f2-1e78-4585-9a8b-7154c97ec053 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:10.736786 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8bec66f2-1e78-4585-9a8b-7154c97ec053 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:10.856411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8bec66f2-1e78-4585-9a8b-7154c97ec053 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:10.866786 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8bec66f2-1e78-4585-9a8b-7154c97ec053 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1219 microversion: 2.1 time: 0.136242 Jul 12 16:24:10.869643 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 192/372] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:10 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:10.892012 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:10.916274 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:10.924969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:10.935962 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a3bd82bb-c553-457b-aaf6-3557fa04ee3c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.505101 Jul 12 16:24:10.936558 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 181/373] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:10 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:11.291774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:11.293022 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:11.308490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.312813 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:11.318393 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.320691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:11.446745 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:11.447445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:11.467797 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.469178 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:11.470046 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.470488 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:11.663517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:11.674091 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ff46424a-d7f2-4615-8419-f9bba7ff702b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.388227 Jul 12 16:24:11.675901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 193/374] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:11 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:11.805133 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:11.815201 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-95f8dedd-1b48-49df-b219-7a58163b0814 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1278 microversion: 2.1 time: 0.372374 Jul 12 16:24:11.816300 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 182/375] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:11 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1278 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:11.885875 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:11.888087 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:11.900669 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.901398 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:11.903046 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.903671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:11.955864 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:11.957567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:11.970723 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.971464 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:11.972394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:11.972997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:12.050390 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:12.060770 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7d8ab3c8-67c0-43b0-84f3-d4ee7c3697d2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1223 microversion: 2.1 time: 0.178642 Jul 12 16:24:12.061932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 194/376] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:11 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1223 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:12.251561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:12.272186 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:12.279548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:12.281075 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-842586bf-bd4a-41e2-ba43-b3f51d3b8c16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.329109 Jul 12 16:24:12.285826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 183/377] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:11 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:12.700294 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:12.701232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:12.707779 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:12.708445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:12.709417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:12.710141 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:12.832359 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:12.833447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:12.840356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:12.840795 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:12.841731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:12.842325 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:12.857654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:12.866389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-711deb1f-5bf9-41e1-a0a7-cfd4a6711c9d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.170687 Jul 12 16:24:12.870956 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 195/378] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:12 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:13.007433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:13.015269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-78c20c86-f76b-41de-a0a4-6959a9d55fa2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1278 microversion: 2.1 time: 0.187311 Jul 12 16:24:13.016047 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 184/379] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:12 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:13.079176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:13.080431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:13.086785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:13.087226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:13.087982 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:13.088411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:13.198122 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:13.207774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6e29a2d4-a7f9-4858-a3ca-3e79ed2c9279 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1223 microversion: 2.1 time: 0.133204 Jul 12 16:24:13.209156 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 196/380] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:13 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:13.307351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:13.309454 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:13.321012 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:13.321499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:13.331516 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:13.331974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:13.778562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:13.801106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:13.804462 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:13.810509 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-da34751b-1ef3-4abf-aa5c-bc03eea12593 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.510566 Jul 12 16:24:13.812243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 185/381] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:13 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:13.885071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:13.886051 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:13.895330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:13.896184 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:13.897373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:13.898202 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:14.033259 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:14.034641 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:14.048011 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:14.049660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:14.053224 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:14.054233 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:14.143496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:14.160163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:14.172242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f38b32ae-e3d9-4b74-9f97-d3ca99d8914f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.288700 Jul 12 16:24:14.173184 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 197/382] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:13 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:14.225505 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:14.226191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:14.245240 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:14.245696 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:14.256375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:14.257269 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:14.364181 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:14.372658 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d1de103a-5221-4049-a6c2-95a2ca8522be tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1271 microversion: 2.1 time: 0.150978 Jul 12 16:24:14.380786 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 198/383] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:14 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:14.449854 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:14.491860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-57bd72c2-dcbb-4c9a-afe6-ce18369878cd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1278 microversion: 2.1 time: 0.462901 Jul 12 16:24:14.502942 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 186/384] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:14 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1278 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:14.783093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-32c41d7b-866f-4397-b137-185327c9eaf0 req-79d81320-e285-448b-b6e0-39d9a4140c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a46c12-84ab-439b-8713-9f1c53c96387", "tag": "d87184f1-4c6a-40cd-8e42-e46af9d4a593"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:14.812619 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-32c41d7b-866f-4397-b137-185327c9eaf0 req-79d81320-e285-448b-b6e0-39d9a4140c11 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:14.813381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-32c41d7b-866f-4397-b137-185327c9eaf0 req-79d81320-e285-448b-b6e0-39d9a4140c11 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:14.830570 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-32c41d7b-866f-4397-b137-185327c9eaf0 req-79d81320-e285-448b-b6e0-39d9a4140c11 service nova] Creating event network-changed:d87184f1-4c6a-40cd-8e42-e46af9d4a593 for instance e7a46c12-84ab-439b-8713-9f1c53c96387 on hv-cinder-79760 Jul 12 16:24:14.832790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:14.833439 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:14.837205 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-32c41d7b-866f-4397-b137-185327c9eaf0 req-79d81320-e285-448b-b6e0-39d9a4140c11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059308 Jul 12 16:24:14.842768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 199/385] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:14.849150 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:14.866157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:14.867467 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:14.869179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:15.086782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:15.098688 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:15.100450 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:15.102787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d50b8bd6-bf67-4c6e-964a-1b61a167d120 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.274737 Jul 12 16:24:15.104663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 187/386] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:14 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:15.191446 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:15.193149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:15.217365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:15.219173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:15.222475 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:15.224850 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:15.400549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:15.402155 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:15.413532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:15.414262 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:15.417314 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:15.419120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:15.463641 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:15.478151 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5bd3add9-d9a8-4786-8379-4b6134d4ae66 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.291722 Jul 12 16:24:15.489247 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 200/387] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:15 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:15.522323 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:15.523496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:15.539205 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:15.547799 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:15.548248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:15.549024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:15.549509 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:15.551131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2beea09c-d675-455f-a4d2-4dba16f31b8a tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1271 microversion: 2.1 time: 0.156893 Jul 12 16:24:15.561114 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 188/388] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:15 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:15.829433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:15.839853 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ab418b58-e13a-4a40-952f-dcfca985e3ac tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1278 microversion: 2.1 time: 0.329377 Jul 12 16:24:15.841206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 201/389] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:15 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:16.123394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:16.124827 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:16.137370 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.139792 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.140872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.141542 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.359510 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:16.368163 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:16.370537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:16.372440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-63818408-9fda-4cbf-bafe-ebe8be2c5ed7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.253708 Jul 12 16:24:16.374503 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 189/390] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:16 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:16.497081 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:16.498032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:16.519744 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.520495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.521485 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.522115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.568649 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:16.569411 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:16.581313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.582342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.583374 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.584030 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.600141 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:16.878094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:16.893773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b3b5828b-5305-4e50-b5f7-51212105bc2e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1271 microversion: 2.1 time: 0.329223 Jul 12 16:24:16.895752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 190/391] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:16 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1271 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:16.901061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:16.904725 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:16.920463 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.920944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.921761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:16.922216 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:16.923203 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:16.934771 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8b92807f-653f-4281-851d-87d01df95aa6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.442591 Jul 12 16:24:16.950210 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 202/392] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:16 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:17.131690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:17.141771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d2423d7e-015d-4172-8859-afe0a1f6da3a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1278 microversion: 2.1 time: 0.243677 Jul 12 16:24:17.143406 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 191/393] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:16 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:17.392358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:17.393042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:17.408101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:17.408544 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:17.409340 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:17.409781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:17.590423 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:17.599595 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:17.602675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:17.604109 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0f309d2b-d1a9-4112-a377-725905c84744 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.215600 Jul 12 16:24:17.605165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 203/394] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:17 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:17.913245 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:17.913879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:17.916269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:17.930239 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:17.930643 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:17.938035 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:17.938557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:17.955891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:17.956885 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:17.967268 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:17.968970 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:17.970538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:17.971244 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:18.135095 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:18.159785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a49903e0-5fb7-4b3c-9628-bcebadc45ae8 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1271 microversion: 2.1 time: 0.251750 Jul 12 16:24:18.160664 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 192/395] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:17 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:18.167663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:18.170722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:18.180661 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:18.182842 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:18.187007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:18.188067 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:18.188674 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:18.283721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:18.299850 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5f2519b2-b4fe-4263-9c70-d18260a769fa tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1509 microversion: 2.1 time: 0.347767 Jul 12 16:24:18.300444 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 204/396] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:17 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:18.513618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:18.527964 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-17d3137b-2211-4912-9825-16d7d54a5f0f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1278 microversion: 2.1 time: 0.365216 Jul 12 16:24:18.528815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 193/397] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:18 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1278 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:18.627020 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:18.628459 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:18.675123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:18.675732 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:18.676610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:18.677176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:18.930057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:18.946634 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:18.950498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:18.952227 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9acc9df9-015c-42d7-a7ce-c0a8ce78a2a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.330979 Jul 12 16:24:18.964918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 205/398] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:18 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:19.189757 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:19.190964 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:19.216611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.218653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:19.222616 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.247724 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:19.317003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:19.317674 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:19.326981 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.329589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:19.333617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.333967 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:19.426212 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:19.439718 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-051b212a-2a28-41d1-865d-8c6a3fc3471f tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1277 microversion: 2.1 time: 0.262372 Jul 12 16:24:19.440608 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 194/399] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:19 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:19.546003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:19.546934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:19.557996 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.559404 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:19.561109 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.563270 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:19.604179 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:19.616627 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-39667238-d96d-422a-a927-5ebfaaa97e4c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1515 microversion: 2.1 time: 0.303465 Jul 12 16:24:19.617778 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 206/400] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:19 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1515 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:19.893847 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:19.903468 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9b03b994-ad42-450d-91f5-7f14778507ea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.362388 Jul 12 16:24:19.906918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 195/401] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:19 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:19.971784 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:19.972329 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:19.986908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.987368 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:19.988428 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:19.988880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:20.267612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:20.275973 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:20.285826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:20.287070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-18b5972b-2444-4cd9-9557-2279a55a1e02 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.319474 Jul 12 16:24:20.288343 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 207/402] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:19 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:20.458658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:20.459774 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:20.470054 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:20.474544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:20.475527 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:20.476141 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:20.742299 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:20.750353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-aab1efdc-ff41-4f44-ad30-7e97d7c6c0ae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.296475 Jul 12 16:24:20.751536 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 196/403] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:20 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:20.923705 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:20.924324 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:20.926329 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=4 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:20.927025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=14 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:20.937166 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:20.937664 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:20.938669 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:20.938844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:21.100053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:21.108271 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-89cea3b8-f70e-4aed-87b9-17210ef4e41d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.188320 Jul 12 16:24:21.110671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 208/404] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:20 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:21.307429 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:21.308732 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:21.329514 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:21.329805 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:21.330664 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:21.331413 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:21.502561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:21.514341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:21.517808 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:21.519215 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9eac5da6-c8b5-4516-af5d-cd9d2e93df95 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.215676 Jul 12 16:24:21.521232 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 197/405] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:21 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:21.768017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:21.768543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:21.778241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:21.778906 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:21.779859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:21.780464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:21.973890 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:21.982248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a5db287e-4d12-461f-abc1-fe15b75a49a6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.218127 Jul 12 16:24:21.982838 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 209/406] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:21 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:22.127589 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:22.128118 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:22.135511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:22.136123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:22.137818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:22.138263 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:22.292087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:22.300096 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1bf1c76d-aec4-4265-bba1-e174fba0423f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.176517 Jul 12 16:24:22.300858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 198/407] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:22 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:22.542125 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:22.543419 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:22.559652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:22.560106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:22.561659 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:22.562297 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:22.860116 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:22.881936 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:22.884607 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:22.888944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d7864f07-be62-4972-8e53-9c9241a9d8e4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.351222 Jul 12 16:24:22.890842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 210/408] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:22 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:22.999781 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:23.000567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:23.009592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:23.021854 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:23.022871 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:23.023437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:23.319962 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:23.321423 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:23.335236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:23.338381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:23.340273 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:23.343139 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:23.368506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:23.380607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-081c45e1-83c6-4d9d-8a79-7d011ea77d71 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.384616 Jul 12 16:24:23.381516 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 199/409] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:22 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:23.567729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-43a151ec-bd47-4ce8-9daa-7512101f2488 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'create', calling method: .version_select at 0x7f1da6482700>, body: {"keypair": {"name": "tempest-keypair-1199178828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk8O+T7VL+tGKwQLbDs0zUoxs4O/lmn9N20wn3BHnv4gcFX6IB0H1FtLmtxakkEahAIPvBL8sris7g0myMk+v07/CmwX0GtSoU2oJ9c6JxK6b7PKAe1p3QSMfcEgwI93g=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:23.597559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:23.597989 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-43a151ec-bd47-4ce8-9daa-7512101f2488 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:24:23.609574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9b3f4f9d-0c6f-4efd-a723-5ff76b48de56 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.295737 Jul 12 16:24:23.610326 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 211/410] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:23 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:23.620340 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-43a151ec-bd47-4ce8-9daa-7512101f2488 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for user e980def45e934114a2f0bc7081ffe8e3 and project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:24:23.679635 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-43a151ec-bd47-4ce8-9daa-7512101f2488 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115220 Jul 12 16:24:23.686961 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 200/411] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:24:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:24:23.917087 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:23.918273 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:23.948934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:23.949704 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:23.950876 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:23.954923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:23.963260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-7ec7410d-bab0-4f4b-a282-509e6a3c71e9 req-cbd7bcc3-facb-4d55-9b84-d8b47d6e3699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c98a8af-af6c-48c2-a77f-dc87c3881fe4", "tag": "92e34968-42d0-40f9-b58a-aaca5c7bf657"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:23.981301 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7ec7410d-bab0-4f4b-a282-509e6a3c71e9 req-cbd7bcc3-facb-4d55-9b84-d8b47d6e3699 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:23.982622 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7ec7410d-bab0-4f4b-a282-509e6a3c71e9 req-cbd7bcc3-facb-4d55-9b84-d8b47d6e3699 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:24.016400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-7ec7410d-bab0-4f4b-a282-509e6a3c71e9 req-cbd7bcc3-facb-4d55-9b84-d8b47d6e3699 service nova] Creating event network-changed:92e34968-42d0-40f9-b58a-aaca5c7bf657 for instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 on hv-cinder-79760 Jul 12 16:24:24.028880 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-7ec7410d-bab0-4f4b-a282-509e6a3c71e9 req-cbd7bcc3-facb-4d55-9b84-d8b47d6e3699 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072674 Jul 12 16:24:24.032208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 201/412] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:24:24.242013 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:24.257922 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:24.262510 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:24.263619 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4e12d29e-6e6f-4dab-87ac-e9f22b757790 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1737 microversion: 2.20 time: 0.359357 Jul 12 16:24:24.269162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 212/413] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:23 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1737 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:24.399189 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:24.399980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:24.410005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:24.410817 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:24.412988 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:24.413677 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:24.628590 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:24.629395 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:24.641766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:24.643234 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:24.658187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:24.659045 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:24.825480 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:24.837941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fe8b8411-4145-42fc-a978-ea6d46c30e32 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.443383 Jul 12 16:24:24.838811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 202/414] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:24 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:24.901482 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:24.909820 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-854832e0-37e9-442a-b25d-aa53d72a58b4 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.287148 Jul 12 16:24:24.910389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 213/415] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:24 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:25.285709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:25.292375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:25.301946 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:25.303739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:25.304700 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:25.305810 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:25.690312 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-656021950", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87e78132-cbcf-464c-bc4d-d37d3116174a"}], "security_groups": [{"name": "tempest-securitygroup--154319997"}], "key_name": "tempest-keypair-1199178828", "user_data": "}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:25.692780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:25.715018 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:25.718905 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:25.720143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c0858a72-da69-4256-808d-302c7467e150 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1719 microversion: 2.20 time: 0.438272 Jul 12 16:24:25.723348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 203/416] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:25 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1719 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:25.842245 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] validate_networks() for [('87e78132-cbcf-464c-bc4d-d37d3116174a', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:24:25.858498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:25.859131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:25.881098 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:25.882468 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:25.883426 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:25.884025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:26.156325 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:26.165906 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-be2b3dff-a819-41e6-8fbc-ce014dcb03aa tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.314010 Jul 12 16:24:26.167281 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 204/417] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:25 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:26.174057 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:26.175047 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:26.181433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:26.182156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:26.183001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:26.184285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:26.312286 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:24:26.312706 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:24:26.313201 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:24:26.313776 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:24:26.314420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:24:26.335063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:26.336113 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:26.337190 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:26.337839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:26.338748 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:26.348353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-81217459-e089-4356-ba82-4a2af4ce2640 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.178622 Jul 12 16:24:26.349522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 205/418] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:26 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:26.360518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:24:26.365427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Getting quotas for user e980def45e934114a2f0bc7081ffe8e3 and project 641dd5eac4cf4352924c1610407bc5e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:24:26.376573 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:26.378021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:24:26.380637 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:24:26.431457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-534454b0-439f-45b6-801d-d9d9039bb3b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.745389 Jul 12 16:24:26.437637 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 214/419] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:24:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:24:26.442772 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-beb96af8-c304-4bc7-9f7f-8125178693bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:26.443613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-beb96af8-c304-4bc7-9f7f-8125178693bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:26.518847 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-beb96af8-c304-4bc7-9f7f-8125178693bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:26.525521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-beb96af8-c304-4bc7-9f7f-8125178693bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1245 microversion: 2.1 time: 0.086573 Jul 12 16:24:26.527241 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 206/420] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:26 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:26.746532 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:26.748463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:26.756738 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:26.757753 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:26.759015 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:26.759895 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:26.926678 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:26.930150 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:26.936849 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:26.938758 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:26.940180 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8fc1dc34-3119-4155-8a67-3b827cfb444d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1719 microversion: 2.20 time: 0.198632 Jul 12 16:24:26.941073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 215/421] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:26 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:24:27.185217 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:27.186351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:27.199944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.200704 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.201865 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.202241 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.368029 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:27.368661 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:27.379419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:27.391108 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e5d345c3-395b-47cf-b288-6f28ea089ae2 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.210638 Jul 12 16:24:27.400358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 207/422] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:27 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:27.401308 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.403478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.405630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.406842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.525299 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-a62fc26c-6808-4d41-86ed-d36f524458cf req-cd1b7420-3c97-424b-a00a-8970eec4c7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6459fa8-bfbc-40a1-af27-2d44bad65d98", "name": "network-vif-unplugged", "status": "completed", "tag": "2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:27.545191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-a62fc26c-6808-4d41-86ed-d36f524458cf req-cd1b7420-3c97-424b-a00a-8970eec4c7f8 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.545638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-a62fc26c-6808-4d41-86ed-d36f524458cf req-cd1b7420-3c97-424b-a00a-8970eec4c7f8 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.562925 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-a62fc26c-6808-4d41-86ed-d36f524458cf req-cd1b7420-3c97-424b-a00a-8970eec4c7f8 service nova] Creating event network-vif-unplugged:2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4 for instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 on hv-cinder-79760 Jul 12 16:24:27.568164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-a62fc26c-6808-4d41-86ed-d36f524458cf req-cd1b7420-3c97-424b-a00a-8970eec4c7f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048939 Jul 12 16:24:27.569022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 208/423] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:27.574686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:27.575396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:27.582277 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.582787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.583573 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.584021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.619531 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:27.628612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-18b8f3ea-c2c3-44df-ae10-576c105bdf45 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.266115 Jul 12 16:24:27.638006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 216/424] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:27 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:27.666437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:27.675546 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6675b7c5-7830-4b6f-b748-29ae20762373 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1249 microversion: 2.1 time: 0.105334 Jul 12 16:24:27.676193 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 209/425] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:27 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1249 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:27.959229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:27.960136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:27.967445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.968025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:27.968879 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:27.969412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:28.165165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:28.174009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:28.175521 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:28.176668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-318e7962-da84-4fb0-82c3-afaebc16524e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1719 microversion: 2.20 time: 0.221536 Jul 12 16:24:28.177250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 217/426] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:27 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:28.410860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:28.413115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:28.421736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:28.422410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:28.424200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:28.424652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:28.433121 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:28.616136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:28.624627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7402ed47-0679-4d02-91fd-54074cfc6762 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.219533 Jul 12 16:24:28.625341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 210/427] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:28 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:28.649029 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:28.649663 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:28.656435 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:28.656986 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:28.658001 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:28.658828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:28.693488 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:28.694292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:28.701291 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:28.702021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:28.702993 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:28.703656 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:28.778043 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:28.786884 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5795107f-4a94-4bbb-aedc-d86e7279cede tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1249 microversion: 2.1 time: 0.097358 Jul 12 16:24:28.797352 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 211/428] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:28 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:28.860331 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:28.869386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7c434693-13ca-42f6-858c-95c4044a4093 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.226400 Jul 12 16:24:28.870060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 218/429] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:28 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:29.206857 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:29.207418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:29.214804 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:29.215287 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:29.216303 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:29.217169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:29.407176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:29.433883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:29.436339 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:29.438372 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b4816eef-2eb7-495a-bc54-8b9fb65210ee tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1722 microversion: 2.20 time: 0.245616 Jul 12 16:24:29.438926 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 212/430] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:29 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:24:29.457753 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6d688201-ca47-46cd-a3bc-5523d1679e4c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df3abac2-ce05-49a2-96df-725199e8940e"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:29.458953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6d688201-ca47-46cd-a3bc-5523d1679e4c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:29.466032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d688201-ca47-46cd-a3bc-5523d1679e4c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:29.466666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d688201-ca47-46cd-a3bc-5523d1679e4c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:29.467523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d688201-ca47-46cd-a3bc-5523d1679e4c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:29.468232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d688201-ca47-46cd-a3bc-5523d1679e4c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:29.641093 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:29.642174 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:29.652355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:29.653691 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:29.655048 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:29.655712 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:29.979727 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6d688201-ca47-46cd-a3bc-5523d1679e4c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.526688 Jul 12 16:24:29.985119 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 219/431] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jul 12 16:24:29 2022] POST /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments => generated 188 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:24:29.986076 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:29.989391 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:29.990053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:29.994485 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-18d4b642-b668-472f-9d3a-6848d186110c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.357512 Jul 12 16:24:29.998804 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 213/432] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:29 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:30.007314 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.007769 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.008745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.009373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.010036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:30.010658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:30.038727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.039233 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.040032 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.040478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.150141 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:30.160163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fbe50446-4b3e-4104-8ea9-9ffd0108f8bd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1297 microversion: 2.1 time: 0.177834 Jul 12 16:24:30.168593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 220/433] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:29 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1297 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:30.192496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f3093bf6-a09f-4b33-9a39-5ffd4a7fe5c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:30.193086 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f3093bf6-a09f-4b33-9a39-5ffd4a7fe5c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:30.214016 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3093bf6-a09f-4b33-9a39-5ffd4a7fe5c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.214958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3093bf6-a09f-4b33-9a39-5ffd4a7fe5c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.216724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3093bf6-a09f-4b33-9a39-5ffd4a7fe5c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.218392 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f3093bf6-a09f-4b33-9a39-5ffd4a7fe5c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.275813 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:30.286309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-99718c6f-ecb2-4034-9cc7-dccc1a594835 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.285242 Jul 12 16:24:30.287457 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 214/434] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:29 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:30.441351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f3093bf6-a09f-4b33-9a39-5ffd4a7fe5c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/action" status: 202 len: 0 microversion: 2.20 time: 0.245145 Jul 12 16:24:30.441351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 221/435] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 16:24:30 2022] POST /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 16:24:30.443503 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:30.444270 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:30.458664 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.462297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.466025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:30.469955 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:30.780304 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:30.790582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:30.792102 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:30.793583 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7fa11350-c349-44a5-b30c-4230b4a1e2fe tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1748 microversion: 2.20 time: 0.354358 Jul 12 16:24:30.794466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 215/436] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:30 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1748 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:31.020057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:31.023548 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:31.036562 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.037455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:31.038734 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.039338 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:31.178198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:31.179193 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:31.186859 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.187532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:31.189650 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.193815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:31.295615 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:31.307484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a099fe01-86a9-4a72-9713-30678fb41ed3 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.298925 Jul 12 16:24:31.309714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 222/437] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:31 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:31.334704 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:31.335694 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:31.342130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:31.344582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.347257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:31.349192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.349955 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:31.357217 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3a287e82-1ee1-43f8-86a7-f95826ffe105 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1303 microversion: 2.1 time: 0.180265 Jul 12 16:24:31.357842 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 216/438] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:31 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:31.790146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:31.800989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2dee9cc2-28bf-4721-905d-c9bb5b15bb9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.489608 Jul 12 16:24:31.802694 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 223/439] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:31 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:31.817238 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:31.818447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:31.825742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.826445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:31.827386 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:31.828084 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.073795 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:32.091763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:32.093618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:32.094823 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0a1a0f0b-87ac-4e11-86ed-250db086c4a1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1748 microversion: 2.20 time: 0.286563 Jul 12 16:24:32.095379 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 217/440] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:31 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1748 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:32.106157 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-f34f7d20-2745-48b5-991e-f3f119ea6e4a req-68a7653b-0679-4fac-91cc-6f87665a9e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c98a8af-af6c-48c2-a77f-dc87c3881fe4", "name": "network-vif-plugged", "status": "completed", "tag": "92e34968-42d0-40f9-b58a-aaca5c7bf657"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:32.112030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-f34f7d20-2745-48b5-991e-f3f119ea6e4a req-68a7653b-0679-4fac-91cc-6f87665a9e56 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:32.113871 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-f34f7d20-2745-48b5-991e-f3f119ea6e4a req-68a7653b-0679-4fac-91cc-6f87665a9e56 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.155890 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-f34f7d20-2745-48b5-991e-f3f119ea6e4a req-68a7653b-0679-4fac-91cc-6f87665a9e56 service nova] Creating event network-vif-plugged:92e34968-42d0-40f9-b58a-aaca5c7bf657 for instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 on hv-cinder-79760 Jul 12 16:24:32.162380 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-f34f7d20-2745-48b5-991e-f3f119ea6e4a req-68a7653b-0679-4fac-91cc-6f87665a9e56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080487 Jul 12 16:24:32.166102 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 224/441] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:24:32.327111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:32.328052 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:32.345137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:32.346168 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.347252 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:32.347899 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.378785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:32.379442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:32.399014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:32.409286 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.414714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:32.417363 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.671519 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:32.684531 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-13b36bd2-95a5-4821-9702-5aac59fedb67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.312001 Jul 12 16:24:32.695409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 225/442] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:32 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:32.793486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:32.801399 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-311b8dee-ba40-47e2-85cd-a18fb5db2553 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.478644 Jul 12 16:24:32.816160 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 218/443] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:32 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:32.820129 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:32.820948 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:32.829938 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:32.830440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.831337 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:32.831779 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:32.991409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:32.999803 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1a0e1887-7a60-4864-b67b-be07bdf14a9f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.183994 Jul 12 16:24:33.004439 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 226/444] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:32 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:33.115856 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:33.116555 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:33.138660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:33.139607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:33.142461 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:33.143507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:33.436349 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:33.446267 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:33.447776 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:33.449019 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-646056f6-491d-4a0b-a48d-69aaa9538f2b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1750 microversion: 2.20 time: 0.339093 Jul 12 16:24:33.449907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 219/445] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:33 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1750 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:33.525970 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-565ef92e-7c2c-4952-b520-0cfb8020086c req-ba2aab9b-743c-48eb-b939-a37476656422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c565037f-2db4-4746-b8ff-c1e0fbe431df", "tag": "b10043d7-6d3e-46b6-b837-b811a5e4b22a"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:33.537842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-565ef92e-7c2c-4952-b520-0cfb8020086c req-ba2aab9b-743c-48eb-b939-a37476656422 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:33.538548 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-565ef92e-7c2c-4952-b520-0cfb8020086c req-ba2aab9b-743c-48eb-b939-a37476656422 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:33.557667 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-565ef92e-7c2c-4952-b520-0cfb8020086c req-ba2aab9b-743c-48eb-b939-a37476656422 service nova] Creating event network-changed:b10043d7-6d3e-46b6-b837-b811a5e4b22a for instance c565037f-2db4-4746-b8ff-c1e0fbe431df on hv-cinder-79760 Jul 12 16:24:33.564759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-565ef92e-7c2c-4952-b520-0cfb8020086c req-ba2aab9b-743c-48eb-b939-a37476656422 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045268 Jul 12 16:24:33.565717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 227/446] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:33.701900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:33.702507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:33.708463 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:33.708908 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:33.709730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:33.710160 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:33.823942 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:33.824794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:33.834366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:33.834903 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:33.835742 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:33.836176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:33.860363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:33.871610 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-07320410-2617-45be-ac80-1e683ecf623d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.173475 Jul 12 16:24:33.874535 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 220/447] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:33 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:33.999003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:34.015836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:34.016783 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:34.017039 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-778c077c-d9b8-4fb3-abd1-9c2674a7487d tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1319 microversion: 2.1 time: 0.198366 Jul 12 16:24:34.017637 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 228/448] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:33 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:34.023900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:34.024363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:34.025171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:34.025788 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:34.181880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-913b97c1-ae02-4615-a504-86b6326a98b9 req-3086aa77-1b0c-472f-944d-69eef11e4d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a46c12-84ab-439b-8713-9f1c53c96387", "name": "network-vif-plugged", "status": "completed", "tag": "d87184f1-4c6a-40cd-8e42-e46af9d4a593"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:34.193386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-913b97c1-ae02-4615-a504-86b6326a98b9 req-3086aa77-1b0c-472f-944d-69eef11e4d7e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:34.193933 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-913b97c1-ae02-4615-a504-86b6326a98b9 req-3086aa77-1b0c-472f-944d-69eef11e4d7e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:34.206822 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-913b97c1-ae02-4615-a504-86b6326a98b9 req-3086aa77-1b0c-472f-944d-69eef11e4d7e service nova] Creating event network-vif-plugged:d87184f1-4c6a-40cd-8e42-e46af9d4a593 for instance e7a46c12-84ab-439b-8713-9f1c53c96387 on hv-cinder-79760 Jul 12 16:24:34.211672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-913b97c1-ae02-4615-a504-86b6326a98b9 req-3086aa77-1b0c-472f-944d-69eef11e4d7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033831 Jul 12 16:24:34.212249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 229/449] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:24:34.239658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:34.247858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0373acb2-e1b1-404c-8e57-10bde1002f8a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.235919 Jul 12 16:24:34.248373 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 221/450] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:34 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:34.468771 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:34.469512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:34.475685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:34.476135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:34.476894 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:34.477355 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:34.605921 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:34.609483 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:34.615082 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:34.616574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:34.617755 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e97afdf7-ba7b-4da9-b423-d0b0cf32c0e9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.153833 Jul 12 16:24:34.618303 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 230/451] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:34 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:34.890208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:34.890876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:34.896984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:34.897459 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:34.898218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:34.898649 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:35.033977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:35.034587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:35.040153 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:35.042655 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:35.043488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:35.044267 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:35.044704 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:35.048169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bb64c5bf-56f2-481e-9aaa-db4fbe363a56 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.162713 Jul 12 16:24:35.048744 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 222/452] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:34 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:35.182459 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:35.190094 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a35c74ff-09da-4ba0-8e64-afbf43c04191 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1508 microversion: 2.1 time: 0.160164 Jul 12 16:24:35.190799 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 231/453] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:35 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:35.264885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:35.265629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:35.273415 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:35.273850 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:35.274684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:35.275144 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:35.531997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:35.539548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a631537f-9330-4e58-9101-acf704bf60aa tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.279427 Jul 12 16:24:35.550204 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 223/454] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:35 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:35.635699 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:35.636353 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:35.642123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:35.642565 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:35.643329 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:35.643744 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:35.792023 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:35.801516 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:35.803044 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:35.804241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a41a5754-6517-487c-9b9d-3352d19b4c9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.172540 Jul 12 16:24:35.804797 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 232/455] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:35 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:36.065019 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:36.065691 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:36.072125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:36.072607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:36.073395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:36.073826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:36.212157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:36.219511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1342319a-ab6c-4548-a153-0c4130f85e86 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.158480 Jul 12 16:24:36.220069 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 224/456] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:36 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:36.557493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:36.558953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:36.561827 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:36.562491 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=6 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:36.566018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:36.566470 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:36.567236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:36.567672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:36.822813 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:36.823734 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:36.826485 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:36.832533 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:36.833198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:36.834435 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:36.834958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:37.019512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:37.027997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-69e2b810-0468-4e91-895f-3e5be4d51fea tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1266 microversion: 2.1 time: 0.474264 Jul 12 16:24:37.032115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 233/457] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:36 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1266 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:37.052257 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:37.061588 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:37.063309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:37.064519 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b4916c6b-b310-4ca7-a84e-28305e0c04df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.245833 Jul 12 16:24:37.065362 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 225/458] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:36 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:24:37.235918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:37.236529 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:37.242651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:37.243107 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:37.243854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:37.244288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:37.599545 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:37.609146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-bcbc4265-e534-4e0a-ab7c-c4ab5fb0cca2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.376626 Jul 12 16:24:37.609146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 234/459] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:37 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:38.048774 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:38.048774 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:38.055180 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.055615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.056407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.056790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.084185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:38.084899 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:38.101163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.101509 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.102277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.102699 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.218640 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:38.222149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:38.226613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-84e3ba0c-1567-4865-81ab-55c99813e16d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1452 microversion: 2.1 time: 0.182486 Jul 12 16:24:38.227359 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 226/460] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:38 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:38.243286 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:38.244300 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:38.247633 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:38.251942 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.252451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.253170 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.253604 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.257506 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:38.259087 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:38.260325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e938076e-f959-4f3f-8cf8-717f9d295b8c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.180474 Jul 12 16:24:38.261443 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 235/461] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:38 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:24:38.420171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:38.428315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-53612709-5b21-4c31-b1c4-d7332987498c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1452 microversion: 2.1 time: 0.189027 Jul 12 16:24:38.428919 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 227/462] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:38 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:38.628197 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:38.629216 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:38.636828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.637388 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.638281 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:38.638795 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:38.782793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:38.791893 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-faf02b72-78dc-4043-9077-79d6c7213d89 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.169545 Jul 12 16:24:38.792944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 236/463] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:38 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:39.280685 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:39.282786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:39.291666 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:39.293162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:39.294157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:39.295059 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:39.586016 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:39.595535 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:39.597329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:39.598710 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-897a7b41-1601-49b9-8a43-277fa9307f20 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.322440 Jul 12 16:24:39.606612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 228/464] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:39 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:39.808718 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:39.809523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:39.819122 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:39.824307 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:39.825384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:39.825960 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:40.073833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:40.083800 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-92ade3e4-abca-4842-9edc-5edf26d3fcae tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.278938 Jul 12 16:24:40.084864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 237/465] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:39 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:40.621497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:40.622069 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:40.628871 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:40.629345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:40.630111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:40.630540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:40.881762 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:40.895894 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:40.897865 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:40.899175 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-876dcb3a-7d13-4a23-a490-317c24d0ff34 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.285734 Jul 12 16:24:40.910618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 229/466] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:40 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:41.014168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-8e4df288-7f95-48ed-882b-190a12c33018 req-d220ab83-61e1-4cc3-a158-e24389aaa92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a46c12-84ab-439b-8713-9f1c53c96387", "tag": "d87184f1-4c6a-40cd-8e42-e46af9d4a593"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:41.022728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8e4df288-7f95-48ed-882b-190a12c33018 req-d220ab83-61e1-4cc3-a158-e24389aaa92d service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:41.023358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8e4df288-7f95-48ed-882b-190a12c33018 req-d220ab83-61e1-4cc3-a158-e24389aaa92d service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:41.038465 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-8e4df288-7f95-48ed-882b-190a12c33018 req-d220ab83-61e1-4cc3-a158-e24389aaa92d service nova] Creating event network-changed:d87184f1-4c6a-40cd-8e42-e46af9d4a593 for instance e7a46c12-84ab-439b-8713-9f1c53c96387 on hv-cinder-79760 Jul 12 16:24:41.044149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-8e4df288-7f95-48ed-882b-190a12c33018 req-d220ab83-61e1-4cc3-a158-e24389aaa92d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035022 Jul 12 16:24:41.045178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 238/467] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:41.102979 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:41.103596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:41.110645 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:41.111095 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:41.111870 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:41.112309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:41.265957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:41.275220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-98271fdc-c8b5-4539-8d11-c6ec4389a8f7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.176248 Jul 12 16:24:41.276094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 230/468] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:41 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:41.920160 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:41.921191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:41.927738 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:41.928185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:41.928969 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:41.929613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:42.039020 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-68b6b6b8-d653-44d0-9f6b-e82c1bc5eb75 req-b77b3881-9012-4322-b806-2e91ca3afe98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c565037f-2db4-4746-b8ff-c1e0fbe431df", "name": "network-vif-plugged", "status": "completed", "tag": "b10043d7-6d3e-46b6-b837-b811a5e4b22a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:42.063130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-68b6b6b8-d653-44d0-9f6b-e82c1bc5eb75 req-b77b3881-9012-4322-b806-2e91ca3afe98 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:42.064363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-68b6b6b8-d653-44d0-9f6b-e82c1bc5eb75 req-b77b3881-9012-4322-b806-2e91ca3afe98 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:42.084317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-68b6b6b8-d653-44d0-9f6b-e82c1bc5eb75 req-b77b3881-9012-4322-b806-2e91ca3afe98 service nova] Creating event network-vif-plugged:b10043d7-6d3e-46b6-b837-b811a5e4b22a for instance c565037f-2db4-4746-b8ff-c1e0fbe431df on hv-cinder-79760 Jul 12 16:24:42.095515 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-68b6b6b8-d653-44d0-9f6b-e82c1bc5eb75 req-b77b3881-9012-4322-b806-2e91ca3afe98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060055 Jul 12 16:24:42.096566 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 231/469] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:42.107730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:42.119245 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:42.121705 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:42.127285 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1b91d303-35e8-4fcd-9dc8-a468bc0e2bd9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.212640 Jul 12 16:24:42.128608 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 239/470] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:41 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:42.293169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:42.294131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:42.302341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:42.302982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:42.303983 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:42.304588 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:42.476473 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:42.484404 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3db0b570-c377-4f04-8993-acd54ac144af tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.196245 Jul 12 16:24:42.489095 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 232/471] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:42 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:43.147129 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:43.147763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:43.155476 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:43.156182 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:43.157217 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:43.157859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:43.319156 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:43.331439 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:43.333525 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:43.335052 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9c4cfe3e-5c48-4624-9360-581c087d5824 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.192412 Jul 12 16:24:43.335609 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 240/472] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:43 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:43.502720 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:43.503449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:43.510036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:43.510638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:43.512020 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:43.512686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:43.658245 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:43.665645 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6d7a8ba2-0193-4e05-9609-6124e8f3203d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.166893 Jul 12 16:24:43.666202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 233/473] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:43 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:44.353289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:44.353895 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:44.360054 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:44.360502 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:44.361289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:44.361726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:44.508344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:44.518512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:44.520240 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:44.521824 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3d82e6b8-efe1-4743-8d6a-9d8038549db3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.172530 Jul 12 16:24:44.522400 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 241/474] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:44 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:44.683635 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:44.684631 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:44.691943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:44.692395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:44.693200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:44.693639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:44.830386 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:44.838665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fa7098c1-b02d-416c-8108-fe66ff2ea823 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.159514 Jul 12 16:24:44.840157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 234/475] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:44 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:24:45.541386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:45.542025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:45.548841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:45.549628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:45.550621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:45.551056 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:45.696285 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:45.706180 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:45.708204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:45.709628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-688f7c25-1fad-4afb-937d-4623f650a786 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.172239 Jul 12 16:24:45.710191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 242/476] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:45 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:45.855953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:45.856522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:45.863519 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:45.863969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:45.864877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:45.865633 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:46.008326 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:46.017338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-541d5fdd-e595-4f4c-9d4b-bd54445b71c3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.165310 Jul 12 16:24:46.024496 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 235/477] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:45 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:46.727595 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:46.728306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:46.735181 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:46.735523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:46.736305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:46.736735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:46.887867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:46.896214 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:46.897828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:46.899070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4e23321b-ad74-4da7-a59c-ea958d321f77 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.175395 Jul 12 16:24:46.899632 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 243/478] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:46 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:47.034848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:47.035617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:47.043623 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:47.044373 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:47.045181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:47.045621 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:47.182921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:47.190517 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-18e4b079-4521-4e5c-bb0d-5475688874d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.159780 Jul 12 16:24:47.191097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 236/479] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:47 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:47.917893 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:47.918602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:47.924835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:47.925312 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:47.926062 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:47.926490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:48.065274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:48.073864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:48.075371 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:48.076509 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0d8ca010-d2f5-4d40-996c-8f15a45f6e30 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.162554 Jul 12 16:24:48.077804 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 244/480] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:47 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:48.207917 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:48.208532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:48.211385 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:48.216670 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:48.217141 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:48.218406 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:48.218839 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:48.356790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:48.365124 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1c0e425f-22b8-4f74-a460-f0a970c787b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.161132 Jul 12 16:24:48.365905 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 237/481] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:48 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:49.096543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:49.097326 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:49.103364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:49.103845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:49.104759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:49.105036 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:49.236072 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:49.244677 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:49.246204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:49.247341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-239e8847-fb83-42ed-bf6e-cb6284c61003 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.155372 Jul 12 16:24:49.247887 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 245/482] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:49 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:49.383536 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:49.384148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:49.391063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:49.391515 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:49.392384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:49.392858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:49.522295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:49.529765 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0e464b0e-05d0-4a13-bb1d-19a2edb0fbd4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.150088 Jul 12 16:24:49.530323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 238/483] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:49 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:50.264720 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:50.265383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:50.271284 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:50.271728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:50.272481 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:50.272910 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:50.400552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:50.409355 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:50.410861 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:50.412001 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-241b8e66-a344-44ce-9825-242ebd61942c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.151321 Jul 12 16:24:50.412557 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 246/484] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:50 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:50.547507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:50.548332 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:50.554576 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:50.555023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:50.555795 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:50.556231 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:50.776334 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:50.784341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6579bf94-6095-42b7-9e42-5461e99f5bd6 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.241761 Jul 12 16:24:50.784926 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 239/485] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:50 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:51.430971 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:51.431563 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:51.437888 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:51.438366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:51.439140 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:51.439573 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:51.580147 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:51.589340 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:51.590907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:51.592145 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-61c9cab3-98a9-4e66-b568-8dbb41951a13 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.165185 Jul 12 16:24:51.597302 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 247/486] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:51 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:51.801954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:51.802502 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:51.808954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:51.809479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:51.810242 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:51.810692 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:52.082376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:52.089741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-400ae234-64e5-458b-ae8e-c2ab57d35c7b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1370 microversion: 2.1 time: 0.291731 Jul 12 16:24:52.090307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 240/487] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:51 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:52.610881 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:52.611602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:52.618316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:52.618789 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:52.619661 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:52.620288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:52.625324 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:52.755510 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:52.763818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:52.765365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:52.767190 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2aa4b9e2-0a94-4fff-aea5-a5d14f5b7de0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.159566 Jul 12 16:24:52.767755 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 248/488] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:52 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:53.106403 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:53.107015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:53.114237 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.114686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:53.115445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.115880 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:53.247919 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:53.256436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d7a8cd24-0ce6-4b71-8ecf-ab5b151ec056 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1562 microversion: 2.1 time: 0.153884 Jul 12 16:24:53.257130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 241/489] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:24:53 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:24:53.273060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5b8d3904-a2ee-4ab3-aec8-0c668e516e37 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:53.273586 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5b8d3904-a2ee-4ab3-aec8-0c668e516e37 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:53.279387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b8d3904-a2ee-4ab3-aec8-0c668e516e37 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.279831 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b8d3904-a2ee-4ab3-aec8-0c668e516e37 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:53.280581 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b8d3904-a2ee-4ab3-aec8-0c668e516e37 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.281011 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5b8d3904-a2ee-4ab3-aec8-0c668e516e37 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:53.359966 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5b8d3904-a2ee-4ab3-aec8-0c668e516e37 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090690 Jul 12 16:24:53.360685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 249/490] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:24:53 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:24:53.742606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-05b8c805-fe30-4ca3-8742-aafe46aa689c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9fde187-30e8-4ca2-b007-eb1ec478f6c8", "device": "/dev/sdb"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:53.744375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-05b8c805-fe30-4ca3-8742-aafe46aa689c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:53.750350 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05b8c805-fe30-4ca3-8742-aafe46aa689c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.751375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05b8c805-fe30-4ca3-8742-aafe46aa689c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:53.752140 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05b8c805-fe30-4ca3-8742-aafe46aa689c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.752578 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05b8c805-fe30-4ca3-8742-aafe46aa689c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:53.785277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:53.785773 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:53.791883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.792330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:53.793123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:53.793561 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:54.020233 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:54.031600 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-05b8c805-fe30-4ca3-8742-aafe46aa689c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "POST /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293508 Jul 12 16:24:54.032361 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 242/491] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:24:53 2022] POST /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:54.077899 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:54.089832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:54.092584 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:54.094083 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-589ae203-2202-4e46-a2ea-d7482670b632 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.312940 Jul 12 16:24:54.095621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 250/492] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:53 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:24:54.389679 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-d32a9158-5737-452e-bada-80dde2cfeb5f req-d997f738-e3f1-4170-a760-6f7e25949581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c565037f-2db4-4746-b8ff-c1e0fbe431df", "tag": "b10043d7-6d3e-46b6-b837-b811a5e4b22a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:54.398841 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-d32a9158-5737-452e-bada-80dde2cfeb5f req-d997f738-e3f1-4170-a760-6f7e25949581 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:54.399287 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-d32a9158-5737-452e-bada-80dde2cfeb5f req-d997f738-e3f1-4170-a760-6f7e25949581 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:54.410954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-d32a9158-5737-452e-bada-80dde2cfeb5f req-d997f738-e3f1-4170-a760-6f7e25949581 service nova] Creating event network-changed:b10043d7-6d3e-46b6-b837-b811a5e4b22a for instance c565037f-2db4-4746-b8ff-c1e0fbe431df on hv-cinder-79760 Jul 12 16:24:54.415631 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-d32a9158-5737-452e-bada-80dde2cfeb5f req-d997f738-e3f1-4170-a760-6f7e25949581 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030465 Jul 12 16:24:54.416220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 243/493] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:55.113746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:55.114361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:55.120607 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:55.121091 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:55.121858 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:55.122292 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:55.258655 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:55.267549 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:55.269062 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:55.270289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0490f03f-90da-4ed3-b8e2-7a2d2ed83b81 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.161444 Jul 12 16:24:55.270836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 251/494] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:55 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:56.289410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:56.290131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:56.296985 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:56.297327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:56.298259 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:56.298992 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:56.463362 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:56.471945 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:56.473512 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:56.474667 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6f5bd08e-ad5e-4bec-8be7-e93c7f72f943 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.190183 Jul 12 16:24:56.475259 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 244/495] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:56 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:57.492998 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:57.493644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:57.495615 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:24:57.500845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:57.501387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:57.502145 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:57.502582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:57.627392 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:57.635808 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:57.637357 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:57.638539 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2de867a1-668c-47c4-8f09-8b49ca23eaa8 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.149422 Jul 12 16:24:57.639093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 252/496] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:57 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:58.657446 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:58.658051 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:58.664497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:58.664937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:58.665727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:58.666161 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:58.794686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:58.803442 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:58.804935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:58.806100 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-38f6cd5a-c59e-4218-bfd3-60a6db72bdc9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.153026 Jul 12 16:24:58.806659 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 245/497] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:58 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:24:59.824166 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:24:59.824965 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:24:59.831222 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:59.831670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:59.832433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:59.832873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:59.896274 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-28525b2f-5c3e-442b-87a9-1ba15c6c4252 req-fecc1d60-8f66-4a73-82d6-dddb10d4f8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6459fa8-bfbc-40a1-af27-2d44bad65d98", "name": "network-vif-plugged", "status": "completed", "tag": "2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:24:59.905546 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-28525b2f-5c3e-442b-87a9-1ba15c6c4252 req-fecc1d60-8f66-4a73-82d6-dddb10d4f8a7 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:24:59.905942 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-28525b2f-5c3e-442b-87a9-1ba15c6c4252 req-fecc1d60-8f66-4a73-82d6-dddb10d4f8a7 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:24:59.920737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-28525b2f-5c3e-442b-87a9-1ba15c6c4252 req-fecc1d60-8f66-4a73-82d6-dddb10d4f8a7 service nova] Creating event network-vif-plugged:2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4 for instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 on hv-cinder-79760 Jul 12 16:24:59.926289 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-28525b2f-5c3e-442b-87a9-1ba15c6c4252 req-fecc1d60-8f66-4a73-82d6-dddb10d4f8a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033632 Jul 12 16:24:59.926881 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 246/498] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:24:59.966901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:59.975248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:59.976740 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:24:59.978101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9cb04b5d-2e01-4150-ab1c-98c13e9fa860 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.157852 Jul 12 16:24:59.989490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 253/499] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:24:59 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:25:00.881306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ceca8a4f-86fa-4855-9c5c-5ae02bbb4e8e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:00.881883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ceca8a4f-86fa-4855-9c5c-5ae02bbb4e8e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:00.888050 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceca8a4f-86fa-4855-9c5c-5ae02bbb4e8e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:00.888499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceca8a4f-86fa-4855-9c5c-5ae02bbb4e8e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:00.889282 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceca8a4f-86fa-4855-9c5c-5ae02bbb4e8e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:00.889715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceca8a4f-86fa-4855-9c5c-5ae02bbb4e8e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:00.913081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ceca8a4f-86fa-4855-9c5c-5ae02bbb4e8e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20/ips" status: 200 len: 149 microversion: 2.1 time: 0.036067 Jul 12 16:25:00.913706 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 247/500] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:25:00 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:00.924132 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8013ea4-d9ec-476e-aa89-f17d95c5d3bd"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:00.925293 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:00.931265 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:00.931704 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:00.932448 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:00.932877 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:00.996944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:00.997613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:01.004041 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:01.004493 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:01.005286 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:01.005725 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:01.013743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Invalid volume: volume e8013ea4-d9ec-476e-aa89-f17d95c5d3bd is already attached to instances: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: POST /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20/os-volume_attachments HTTP/1.1 Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 74 Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:25:01.015751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {"volumeAttachment": {"volumeId": "e8013ea4-d9ec-476e-aa89-f17d95c5d3bd"}} Jul 12 16:25:01.017675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Invalid volume: volume e8013ea4-d9ec-476e-aa89-f17d95c5d3bd is already attached to instances: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'server_id': 'cc4e4cb1-5677-4912-80a3-18b65ae45b20', 'body': {'volumeAttachment': {'volumeId': 'e8013ea4-d9ec-476e-aa89-f17d95c5d3bd'}}} Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e8013ea4-d9ec-476e-aa89-f17d95c5d3bd is already attached to instances: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:25:01.018589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e8013ea4-d9ec-476e-aa89-f17d95c5d3bd is already attached to instances: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:01.019984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e8013ea4-d9ec-476e-aa89-f17d95c5d3bd is already attached to instances: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 400 to user: Invalid volume: volume e8013ea4-d9ec-476e-aa89-f17d95c5d3bd is already attached to instances: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8bc258a2-e832-4e2b-971f-e23e8f3c1017 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097692 Jul 12 16:25:01.021384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 254/501] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:25:00 2022] POST /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:25:01.027880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:01.028542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:01.035273 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:01.035716 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:01.036475 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:01.036912 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:01.062550 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:25:01.137223 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:01.140210 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-33b160c4-f31d-482d-8c13-14e8fbcee77b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 204 len: 0 microversion: 2.1 time: 0.115897 Jul 12 16:25:01.140940 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 255/502] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:25:01 2022] DELETE /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 16:25:01.146882 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:01.148381 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:01.149570 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ef33daab-e085-4031-8b9a-bf5a45083203 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.156487 Jul 12 16:25:01.150065 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:01.150210 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 248/503] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:25:00 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:25:01.150896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:01.156745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:01.157265 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:01.158136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:01.158583 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:01.290210 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:01.298130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-898f9d15-89ea-4f27-8687-e022eaa29917 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1678 microversion: 2.1 time: 0.151551 Jul 12 16:25:01.298682 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 256/504] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:01 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:25:02.167742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:02.168348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:02.175291 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:02.175733 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:02.176480 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:02.176909 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:02.301938 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:02.310165 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:02.311662 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:02.312803 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-eea64d3e-ab49-459b-881a-ce3b9a195db7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.148939 Jul 12 16:25:02.313921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 249/505] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:25:02 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:25:02.316832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:02.317466 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:02.323600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:02.324046 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:02.324809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:02.325268 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:02.454678 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:02.462064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5ee50d06-e123-4ca7-863a-d3422cd027ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1678 microversion: 2.1 time: 0.149654 Jul 12 16:25:02.462645 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 257/506] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:02 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:25:03.331923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:03.332546 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:03.338931 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:03.339376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:03.340123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:03.340550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:03.465842 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:03.474091 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:03.475592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:03.476736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a4077cfb-f50e-469e-a6ab-a4924b08420f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.149333 Jul 12 16:25:03.477316 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 250/507] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:25:03 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:25:03.479620 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:03.480236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:03.486858 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:03.487565 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:03.488317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:03.488748 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:03.616907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:03.624338 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-53a824a0-9600-4cdb-8433-e0a4f92b7ff5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1678 microversion: 2.1 time: 0.148578 Jul 12 16:25:03.624976 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 258/508] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:03 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:25:04.495437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:04.496238 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:04.502785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:04.503321 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:04.504152 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:04.504652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:04.642409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:04.643563 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:04.649841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:04.650488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:04.651409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:04.652006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:04.718935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:04.720379 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:04.728071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-abb0e40f-4a30-40cb-a82f-35cc2c154f28 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1611 microversion: 2.1 time: 0.090028 Jul 12 16:25:04.733229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 259/509] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:04 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:04.733387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:04.733387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:04.733579 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-bd3a7678-6dea-4e25-8c86-68626ba6d160 req-20d4ef67-c1c3-4fb8-be2e-6c1ac04f99f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4e4cb1-5677-4912-80a3-18b65ae45b20", "name": "network-vif-deleted", "tag": "b4434c94-2bb5-4c14-b51e-bafabf825dbf"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:04.733665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-56881970-4c26-47f5-aa07-4a69debf9b17 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.241881 Jul 12 16:25:04.734108 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 251/510] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:25:04 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:25:04.744415 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-bd3a7678-6dea-4e25-8c86-68626ba6d160 req-20d4ef67-c1c3-4fb8-be2e-6c1ac04f99f0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:04.744415 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-bd3a7678-6dea-4e25-8c86-68626ba6d160 req-20d4ef67-c1c3-4fb8-be2e-6c1ac04f99f0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:04.754809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-bd3a7678-6dea-4e25-8c86-68626ba6d160 req-20d4ef67-c1c3-4fb8-be2e-6c1ac04f99f0 service nova] Creating event network-vif-deleted:b4434c94-2bb5-4c14-b51e-bafabf825dbf for instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 on hv-cinder-79760 Jul 12 16:25:04.759569 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-bd3a7678-6dea-4e25-8c86-68626ba6d160 req-20d4ef67-c1c3-4fb8-be2e-6c1ac04f99f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029417 Jul 12 16:25:04.760157 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 260/511] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:05.745654 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:05.747700 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:05.752144 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:05.753449 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:05.755348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:05.755906 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:05.756763 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:05.757528 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:05.762257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:05.762920 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:05.763854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:05.764521 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:05.832445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:05.841844 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b8ed6a12-8138-43df-911a-11a2b46162b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1324 microversion: 2.1 time: 0.099960 Jul 12 16:25:05.843384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 252/512] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:05 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1324 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:05.926009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:05.934449 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:05.935967 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:05.937142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-409852c9-e3da-4d38-b7da-c6d7e89f6dc2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.189230 Jul 12 16:25:05.937700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 261/513] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:25:05 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:25:06.859857 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:06.861004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:06.867752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:06.868195 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:06.868937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:06.869387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:06.931248 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:06.938629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e386996c-184d-4f11-93fa-bfd4cc28b26e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1324 microversion: 2.1 time: 0.082664 Jul 12 16:25:06.939180 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 253/514] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:06 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1324 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:06.954513 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:06.955153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:06.961164 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:06.961614 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:06.962374 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:06.962811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:07.089657 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:07.098762 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:07.101510 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:07.101900 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ec1ec86a-f2ab-4d27-9eb0-250131c01eed tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1806 microversion: 2.20 time: 0.151154 Jul 12 16:25:07.112007 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 262/515] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:25:06 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:25:07.955780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:07.956426 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:07.962854 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:07.963337 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:07.964099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:07.964538 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:07.996547 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:07.996996 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:07.997581 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lazy-loading 'fault' on Instance uuid cc4e4cb1-5677-4912-80a3-18b65ae45b20 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:25:08.040683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:08.048837 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-84b479f6-b5ba-45c0-9151-0364a38eef56 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 200 len: 1329 microversion: 2.1 time: 0.097493 Jul 12 16:25:08.049433 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 254/516] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:07 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:08.120512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:08.121160 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:08.127782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:08.128271 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:08.128963 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:08.129434 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:08.258162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:08.266862 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:08.268450 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:08.269750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-155f9db5-6ee4-4b8a-9b62-0dc087a3e51a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1793 microversion: 2.20 time: 0.153154 Jul 12 16:25:08.282099 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 263/517] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:25:08 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1793 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:25:09.065890 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:09.066493 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:09.073614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:09.074052 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:09.074801 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:09.075230 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:09.088513 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 HTTP/1.1 Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:25:09.090147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:25:09.091684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'cc4e4cb1-5677-4912-80a3-18b65ae45b20'} Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:25:09.092918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:25:09.095317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:09.097628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:25:09.097628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2bd0f7c4-369c-4882-9296-aad178e4ea2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 404 len: 111 microversion: 2.1 time: 0.029445 Jul 12 16:25:09.097628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 255/518] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:09 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:25:09.103161 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-be9c88d3-0059-4a98-915e-d663f492d586 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '.version_select at 0x7f1da5a36550>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:09.121393 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-be9c88d3-0059-4a98-915e-d663f492d586 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968719657" status: 202 len: 0 microversion: 2.1 time: 0.021846 Jul 12 16:25:09.122006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 264/519] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 12 16:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968719657 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:25:09.768119 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:09.768639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:09.774625 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:09.775064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:09.775810 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:09.776235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:09.898179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lazy-loading 'services' on Instance uuid 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:25:10.009749 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4e4ad631-4923-4a15-90e8-f990834933e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments/e8013ea4-d9ec-476e-aa89-f17d95c5d3bd" status: 202 len: 0 microversion: 2.1 time: 0.245347 Jul 12 16:25:10.010328 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 256/520] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:25:09 2022] DELETE /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments/e8013ea4-d9ec-476e-aa89-f17d95c5d3bd => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:25:10.018613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d114d591-87c4-4b67-81e8-133880b06c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:10.019522 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d114d591-87c4-4b67-81e8-133880b06c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:10.025739 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d114d591-87c4-4b67-81e8-133880b06c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:10.026194 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d114d591-87c4-4b67-81e8-133880b06c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:10.026968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d114d591-87c4-4b67-81e8-133880b06c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:10.027464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d114d591-87c4-4b67-81e8-133880b06c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:10.031387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:10.059896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d114d591-87c4-4b67-81e8-133880b06c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Jul 12 16:25:10.060448 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 265/521] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:25:10 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:11.073037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c5196296-55b0-4695-8216-a52ad8708541 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:11.074105 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c5196296-55b0-4695-8216-a52ad8708541 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:11.080730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5196296-55b0-4695-8216-a52ad8708541 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:11.081202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5196296-55b0-4695-8216-a52ad8708541 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:11.081952 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5196296-55b0-4695-8216-a52ad8708541 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:11.082386 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c5196296-55b0-4695-8216-a52ad8708541 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:11.113986 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c5196296-55b0-4695-8216-a52ad8708541 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Jul 12 16:25:11.114537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 257/522] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:25:11 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:12.125890 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5dc87245-4653-4e84-879a-b1b7c96b01c8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:12.126806 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5dc87245-4653-4e84-879a-b1b7c96b01c8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:12.133529 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5dc87245-4653-4e84-879a-b1b7c96b01c8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:12.134016 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5dc87245-4653-4e84-879a-b1b7c96b01c8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:12.134804 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5dc87245-4653-4e84-879a-b1b7c96b01c8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:12.135306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5dc87245-4653-4e84-879a-b1b7c96b01c8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:12.165998 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5dc87245-4653-4e84-879a-b1b7c96b01c8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044140 Jul 12 16:25:12.166548 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 266/523] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:25:12 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:25:12.223778 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:12.224260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:12.230747 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:12.231202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:12.231980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:12.232416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:12.257772 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:25:12.339338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e88d4db3-875d-4308-b021-239d582e6627 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 204 len: 0 microversion: 2.1 time: 0.119051 Jul 12 16:25:12.344091 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 258/524] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:25:12 2022] DELETE /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:25:12.349517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:12.350164 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:12.359805 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:12.360434 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:12.361313 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:12.361735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:12.491478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:12.498829 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7e18ee46-0ffd-4fba-91c0-1620870ff6a9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1683 microversion: 2.1 time: 0.154558 Jul 12 16:25:12.499383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 267/525] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:12 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:25:13.516431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:13.517167 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:13.524176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:13.524628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:13.525436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:13.525875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:13.529926 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:13.654195 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:13.661691 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-be19e0e4-561b-469c-a0cd-1e9c199d9c9e tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1683 microversion: 2.1 time: 0.149571 Jul 12 16:25:13.662254 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 259/526] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:13 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:14.678691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:14.679300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:14.685384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:14.685833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:14.686587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:14.687018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:14.817514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:14.824851 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9e182ce3-e14c-4bb1-856a-d7386a0b1af6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1683 microversion: 2.1 time: 0.150098 Jul 12 16:25:14.825446 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 268/527] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:14 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:15.841923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:15.842542 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:15.849567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:15.850016 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:15.850774 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:15.851210 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:15.982623 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:15.990611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4f645e02-cce9-45fe-bfe7-a5befd97ea09 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1683 microversion: 2.1 time: 0.152408 Jul 12 16:25:15.991218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 260/528] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:15 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:17.007898 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:17.008554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:17.016115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:17.016571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:17.017388 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:17.018144 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:17.053175 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-75a646e6-fa6a-4e90-974d-ebb082b3c320 req-1c788f44-2635-4dc4-8488-542ed52df57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b", "name": "network-vif-deleted", "tag": "ee938d9d-4c97-4e36-891d-386db9564d75"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:17.063037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-75a646e6-fa6a-4e90-974d-ebb082b3c320 req-1c788f44-2635-4dc4-8488-542ed52df57a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:17.063851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-75a646e6-fa6a-4e90-974d-ebb082b3c320 req-1c788f44-2635-4dc4-8488-542ed52df57a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:17.077791 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-75a646e6-fa6a-4e90-974d-ebb082b3c320 req-1c788f44-2635-4dc4-8488-542ed52df57a service nova] Creating event network-vif-deleted:ee938d9d-4c97-4e36-891d-386db9564d75 for instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b on hv-cinder-79760 Jul 12 16:25:17.083934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-75a646e6-fa6a-4e90-974d-ebb082b3c320 req-1c788f44-2635-4dc4-8488-542ed52df57a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034461 Jul 12 16:25:17.084739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 261/529] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:25:17.089332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:17.099250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3d7a7f8e-98df-42f4-88db-ed84aaa06399 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 200 len: 1615 microversion: 2.1 time: 0.095100 Jul 12 16:25:17.109361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 269/530] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:17 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 1615 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:18.118667 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:18.119390 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:18.125577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:18.126021 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:18.126773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:18.127203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:18.139913 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b HTTP/1.1 Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:25:18.141526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:25:18.143137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b'} Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:25:18.144162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:25:18.145715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:18.147244 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:25:18.147244 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-58145e13-b10b-45d5-8079-1d2786ed71d0 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 404 len: 111 microversion: 2.1 time: 0.029570 Jul 12 16:25:18.147244 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 262/531] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:18 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:25:18.151593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7425f334-a4fb-45b3-90f5-2d2b910992a3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '.version_select at 0x7f1da5ab99d0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:18.168841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7425f334-a4fb-45b3-90f5-2d2b910992a3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297231987" status: 202 len: 0 microversion: 2.1 time: 0.021055 Jul 12 16:25:18.169421 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 270/532] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 16:25:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297231987 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:25:18.768875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8764ab55-8538-409e-9251-e13e5065fb02 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: .version_select at 0x7f1da62b2ca0>, body: {"keypair": {"name": "tempest-keypair-1494195506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/8u/Fw+qCCzSMofQydq0SY6g3bTZ0UrLheGh8dCDUlEjMObSVtQdTDvOromfdFZCBQNUMydk4n3tOHTW905O0b0CGXiPTw5OGgi51nVuSq7AcuHOz7VXoJcK5ezF6opA=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:18.776317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:18.789586 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-8764ab55-8538-409e-9251-e13e5065fb02 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:25:18.793314 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-8764ab55-8538-409e-9251-e13e5065fb02 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:25:18.814197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8764ab55-8538-409e-9251-e13e5065fb02 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049395 Jul 12 16:25:18.814781 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 263/533] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:25:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:19.826740 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:19.827329 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:19.833521 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:19.833976 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:19.834752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:19.835195 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:19.963556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lazy-loading 'services' on Instance uuid 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:25:20.069831 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-761605473", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39"}], "security_groups": [{"name": "tempest-securitygroup--897631738"}], "key_name": "tempest-keypair-1494195506", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:20.078214 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-19afef1b-5aaf-4c2e-9680-538ddc183d2c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4/os-volume_attachments/d9fde187-30e8-4ca2-b007-eb1ec478f6c8" status: 202 len: 0 microversion: 2.1 time: 0.255331 Jul 12 16:25:20.079076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 271/534] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:25:19 2022] DELETE /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4/os-volume_attachments/d9fde187-30e8-4ca2-b007-eb1ec478f6c8 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:25:20.193378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] validate_networks() for [('791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:25:20.552454 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:25:20.552876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:25:20.553495 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:25:20.553901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:25:20.554306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:25:20.562915 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:20.563357 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:20.564144 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:20.564574 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:20.584306 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:25:20.588214 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:25:20.599468 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:25:20.601731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:25:20.647653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4aebea60-0d80-4de3-ae8f-255245275d47 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.582958 Jul 12 16:25:20.648387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 264/535] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:25:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 16:25:20.658680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c4403f77-c16a-4cea-8c8d-aedbad412c6c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:20.659383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c4403f77-c16a-4cea-8c8d-aedbad412c6c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:20.715032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c4403f77-c16a-4cea-8c8d-aedbad412c6c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:20.721897 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c4403f77-c16a-4cea-8c8d-aedbad412c6c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1241 microversion: 2.1 time: 0.067306 Jul 12 16:25:20.722483 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 272/536] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:20 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:21.209655 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:21.210174 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:21.216917 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:21.217453 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:21.218221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:21.218662 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:21.247041 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:25:21.319137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4c578094-7c49-40a9-95cc-aaef1cba7bae tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 204 len: 0 microversion: 2.1 time: 0.113549 Jul 12 16:25:21.319717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 265/537] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:25:21 2022] DELETE /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:25:21.327754 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:21.328503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:21.334722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:21.335191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:21.335932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:21.336368 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:21.466574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:21.474580 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-80b4343f-a4ab-44c6-90a6-2a4743712ffd tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1514 microversion: 2.1 time: 0.150671 Jul 12 16:25:21.475146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 273/538] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:21 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:21.739265 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:21.739903 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:21.745875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:21.746323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:21.747084 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:21.747522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:21.808174 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:21.815492 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-57fb41ce-f87b-481f-a29e-ff1192e762b1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1301 microversion: 2.1 time: 0.080788 Jul 12 16:25:21.816050 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 266/539] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:21 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1301 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:22.491833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:22.492478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:22.498565 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:22.499019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:22.499785 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:22.500220 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:22.624100 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:22.631513 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8338c3c5-c331-4fa8-bba4-d31472ac0250 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1514 microversion: 2.1 time: 0.144319 Jul 12 16:25:22.632076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 274/540] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:22 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:22.832765 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:22.833398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:22.839771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:22.840217 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:22.840963 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:22.841424 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:22.904462 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:22.912454 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6e7b350c-b297-46ea-8961-ff01d6965385 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1301 microversion: 2.1 time: 0.083509 Jul 12 16:25:22.913005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 267/541] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:22 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:23.648356 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:23.648958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:23.654943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:23.655395 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:23.656155 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:23.656593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:23.793310 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:23.801522 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-588f085d-c7e4-4afb-94e4-0a6183dd4679 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 200 len: 1514 microversion: 2.1 time: 0.157003 Jul 12 16:25:23.802192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 275/542] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:23 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:23.929680 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:23.930461 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:23.936683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:23.937156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:23.937922 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:23.938364 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:24.016002 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:24.023773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c1178ca9-7d7b-459d-b64a-6c8a73074ec2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1299 microversion: 2.1 time: 0.098161 Jul 12 16:25:24.024087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 268/543] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:23 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:24.236002 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-844b6cf6-1ba5-411b-beb4-06e75fcbc148 req-8a88f05c-bf0b-4da8-8366-7eed4eeea6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c98a8af-af6c-48c2-a77f-dc87c3881fe4", "name": "network-vif-deleted", "tag": "92e34968-42d0-40f9-b58a-aaca5c7bf657"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:24.245673 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-844b6cf6-1ba5-411b-beb4-06e75fcbc148 req-8a88f05c-bf0b-4da8-8366-7eed4eeea6cf service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:24.246352 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-844b6cf6-1ba5-411b-beb4-06e75fcbc148 req-8a88f05c-bf0b-4da8-8366-7eed4eeea6cf service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:24.258659 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-844b6cf6-1ba5-411b-beb4-06e75fcbc148 req-8a88f05c-bf0b-4da8-8366-7eed4eeea6cf service nova] Creating event network-vif-deleted:92e34968-42d0-40f9-b58a-aaca5c7bf657 for instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 on hv-cinder-79760 Jul 12 16:25:24.264745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-844b6cf6-1ba5-411b-beb4-06e75fcbc148 req-8a88f05c-bf0b-4da8-8366-7eed4eeea6cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032207 Jul 12 16:25:24.265636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 276/544] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:25:24.819176 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:24.819882 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 4c98a8af-af6c-48c2-a77f-dc87c3881fe4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:24.825973 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:24.826500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:24.827332 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:24.827836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:24.841369 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] HTTP exception thrown: Instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 could not be found. Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Request method failure captured: Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 HTTP/1.1 Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaAospzr-s5vrxOZYpelIXeCXKXKYpbUklSHQ2M7wEaReB7hrF9EuSeeEQHgkTZi9_vH5yRSkuR96_eEUkbEifR0FAwobKYQ65qx_hXSB0EIv4IoeBZCCOn22L9kv66zGMuuUnzyPGd9ogEf4CylRj6easELPsgLCLQ4nfKqEhIT8sU Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 16d93a63cf174aa9b006723dd55a523c Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesSnapshotTestJSON-179462763 Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:25:24.843010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16d93a63cf174aa9b006723dd55a523c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16d93a63cf174aa9b006723dd55a523c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16d93a63cf174aa9b006723dd55a523c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16d93a63cf174aa9b006723dd55a523c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesSnapshotTestJSON-179462763 Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 16d93a63cf174aa9b006723dd55a523c Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-179462763 Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesSnapshotTestJSON-179462763-project Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: a9d0db5db4e647c8ae5edef6c435923c Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesSnapshotTestJSON-179462763-project Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 could not be found. Jul 12 16:25:24.844521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '4c98a8af-af6c-48c2-a77f-dc87c3881fe4'} Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 could not be found. Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:25:24.845470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 could not be found. Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 could not be found. Jul 12 16:25:24.846954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:25:24.848131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Returning 404 to user: Instance 4c98a8af-af6c-48c2-a77f-dc87c3881fe4 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:25:24.848131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d8ff768b-f0f0-4cbe-b85f-46a8a192b9a1 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4" status: 404 len: 111 microversion: 2.1 time: 0.029634 Jul 12 16:25:24.848131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 269/545] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:24 2022] GET /compute/v2.1/servers/4c98a8af-af6c-48c2-a77f-dc87c3881fe4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:25:25.040363 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:25.041297 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:25.047761 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:25.048211 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:25.049209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:25.049818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:25.195279 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:25.203095 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3a6bba1c-b41b-4c13-bfd1-9f52bf4cc007 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.167004 Jul 12 16:25:25.203679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 277/546] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:25 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:26.219807 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:26.220422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:26.227499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:26.227948 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:26.228709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:26.229175 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:26.301844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-38d25bf0-553f-471a-a33c-7c783b722e28 req-20317fb1-96da-43aa-adad-04cef9df1f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78b6a91-9299-4181-925f-3967e7df03e5", "tag": "43e12ab9-8b98-4af6-b15a-f9f8a29deb09"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:26.309953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-38d25bf0-553f-471a-a33c-7c783b722e28 req-20317fb1-96da-43aa-adad-04cef9df1f10 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:26.310394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-38d25bf0-553f-471a-a33c-7c783b722e28 req-20317fb1-96da-43aa-adad-04cef9df1f10 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:26.321722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-38d25bf0-553f-471a-a33c-7c783b722e28 req-20317fb1-96da-43aa-adad-04cef9df1f10 service nova] Creating event network-changed:43e12ab9-8b98-4af6-b15a-f9f8a29deb09 for instance c78b6a91-9299-4181-925f-3967e7df03e5 on hv-cinder-79760 Jul 12 16:25:26.327308 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-38d25bf0-553f-471a-a33c-7c783b722e28 req-20317fb1-96da-43aa-adad-04cef9df1f10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028860 Jul 12 16:25:26.327908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 278/547] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:25:26.367118 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:26.374390 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9227e236-a19b-4de4-b319-ac22e2e589aa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.158415 Jul 12 16:25:26.374939 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 270/548] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:26 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:27.392038 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:27.392729 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:27.399447 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:27.399890 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:27.400640 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:27.401100 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:27.527195 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:27.534457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ac1ab57a-7366-48f1-ac62-778a43980deb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.146759 Jul 12 16:25:27.535646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 279/549] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:27 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:28.551871 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:28.552607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:28.559064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:28.559514 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:28.560266 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:28.560698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:28.691925 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:28.699156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c3c7c542-3bf6-4a84-ade0-7a92fa8e1000 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.151736 Jul 12 16:25:28.699712 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 271/550] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:28 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:29.715922 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:29.716566 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:29.718623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:29.724839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:29.725544 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:29.726298 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:29.726732 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:29.855098 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:29.862623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9120505d-c31e-4f90-bf8c-df37502d7aba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.150523 Jul 12 16:25:29.863722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 280/551] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:29 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:30.880179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:30.880806 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:30.883336 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:30.883975 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=10 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:30.890253 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:30.890695 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:30.891474 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:30.891905 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:31.019993 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:31.027296 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-49f16735-6901-4bf4-b19c-7af9836339c9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.151506 Jul 12 16:25:31.027848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 272/552] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:30 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:32.043902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:32.044504 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:32.046436 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:32.051714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:32.052156 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:32.052904 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:32.053358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:32.178655 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:32.185871 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5d30055d-8c48-49ff-8aa7-d699cde4bb25 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.145859 Jul 12 16:25:32.186424 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 281/553] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:32 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:32.650198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1939100793", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "networks": [{"uuid": "56fddaac-aea1-4420-bca9-5159944baa07"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:32.701429 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] validate_networks() for [('56fddaac-aea1-4420-bca9-5159944baa07', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:25:33.202410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:33.203110 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:33.209839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:33.210364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:33.211314 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:33.211828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:33.282010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:25:33.282436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:25:33.282909 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:25:33.283316 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:25:33.283783 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:25:33.293497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:33.293944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:33.294732 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:33.295229 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:33.311764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Getting quotas for project 16d93a63cf174aa9b006723dd55a523c. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:25:33.319445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Getting quotas for user a9d0db5db4e647c8ae5edef6c435923c and project 16d93a63cf174aa9b006723dd55a523c. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:25:33.332145 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:25:33.335096 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:25:33.342833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:33.350232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6bc89678-61d8-4bb1-b2e7-6bef961eb6b9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.151634 Jul 12 16:25:33.350796 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 282/554] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:33 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:33.379612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f75ace87-533c-4edc-b894-1276592d2567 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733227 Jul 12 16:25:33.380896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 273/555] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 16:25:33.390602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f252358a-48d1-4b9e-9c45-42a5bda975ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:33.391213 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f252358a-48d1-4b9e-9c45-42a5bda975ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:33.442722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f252358a-48d1-4b9e-9c45-42a5bda975ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:33.450278 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f252358a-48d1-4b9e-9c45-42a5bda975ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1219 microversion: 2.1 time: 0.063489 Jul 12 16:25:33.450836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 283/556] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:33 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:34.368445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:34.369786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:34.376334 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:34.377032 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:34.378160 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:34.378842 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:34.467419 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:34.469802 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:34.485364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:34.486351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:34.488051 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:34.490090 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:34.564720 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:34.572680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-04a663e3-61df-4568-bce1-01084e21ad4b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1277 microversion: 2.1 time: 0.109185 Jul 12 16:25:34.573421 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 284/557] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:34 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:25:34.578362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-00d1320e-2374-4923-84a0-7d27d2431c7a req-d4f4d76a-60d8-4585-a1d9-6168f9e96126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78b6a91-9299-4181-925f-3967e7df03e5", "name": "network-vif-plugged", "status": "completed", "tag": "43e12ab9-8b98-4af6-b15a-f9f8a29deb09"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:34.586602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-00d1320e-2374-4923-84a0-7d27d2431c7a req-d4f4d76a-60d8-4585-a1d9-6168f9e96126 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:34.587299 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-00d1320e-2374-4923-84a0-7d27d2431c7a req-d4f4d76a-60d8-4585-a1d9-6168f9e96126 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:34.598681 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-00d1320e-2374-4923-84a0-7d27d2431c7a req-d4f4d76a-60d8-4585-a1d9-6168f9e96126 service nova] Creating event network-vif-plugged:43e12ab9-8b98-4af6-b15a-f9f8a29deb09 for instance c78b6a91-9299-4181-925f-3967e7df03e5 on hv-cinder-79760 Jul 12 16:25:34.604165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-00d1320e-2374-4923-84a0-7d27d2431c7a req-d4f4d76a-60d8-4585-a1d9-6168f9e96126 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029371 Jul 12 16:25:34.605746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 285/558] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:34.607396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:34.616938 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3543f562-360a-477c-b367-d9950c5ab5d5 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.253505 Jul 12 16:25:34.617799 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 274/559] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:34 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:35.590499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:35.591288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:35.597884 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:35.598324 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:35.599773 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:35.600364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:35.604470 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:35.643890 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:35.644506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:35.651823 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:35.652286 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:35.653137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:35.653576 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:35.742491 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:35.749838 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a5081477-da92-4167-9e74-2b25318ddb59 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1319 microversion: 2.1 time: 0.163597 Jul 12 16:25:35.750397 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 286/560] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:35 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:35.836729 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-c88ff7fd-b45a-4fdb-9413-c322f978d74e req-e364e4ba-34db-4475-acda-fdc3c71f74af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "441ac8f6-058b-49e7-83e3-b9d87be7f23c", "tag": "225e04e2-cbbb-475f-973d-9b8d6ff823ab"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:35.847005 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-c88ff7fd-b45a-4fdb-9413-c322f978d74e req-e364e4ba-34db-4475-acda-fdc3c71f74af service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:35.847447 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-c88ff7fd-b45a-4fdb-9413-c322f978d74e req-e364e4ba-34db-4475-acda-fdc3c71f74af service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:35.860908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-c88ff7fd-b45a-4fdb-9413-c322f978d74e req-e364e4ba-34db-4475-acda-fdc3c71f74af service nova] Creating event network-changed:225e04e2-cbbb-475f-973d-9b8d6ff823ab for instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c on hv-cinder-79760 Jul 12 16:25:35.862007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:35.866533 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-c88ff7fd-b45a-4fdb-9413-c322f978d74e req-e364e4ba-34db-4475-acda-fdc3c71f74af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033931 Jul 12 16:25:35.867360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 287/561] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:25:35.871134 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e864b705-301b-4154-9c15-8bbc665e4837 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1366 microversion: 2.1 time: 0.240997 Jul 12 16:25:35.871733 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 275/562] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:35 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:36.767327 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:36.768017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:36.774258 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:36.774703 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:36.775461 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:36.775892 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:36.887770 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:36.888379 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:36.894938 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:36.895382 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:36.896821 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:36.897257 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:36.910006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:36.917409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-67be2d43-e8a6-49d3-8723-625a774e0657 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1319 microversion: 2.1 time: 0.154340 Jul 12 16:25:36.917978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 288/563] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:36 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:37.031283 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:37.038713 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5d2faecc-ef6b-479d-b3cb-6c89e42d8b98 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1556 microversion: 2.1 time: 0.154893 Jul 12 16:25:37.039276 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 276/564] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:36 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:25:37.054945 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-067c4c28-8201-4fe2-b8e4-72129b0e9cd1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:37.055425 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-067c4c28-8201-4fe2-b8e4-72129b0e9cd1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:37.061390 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067c4c28-8201-4fe2-b8e4-72129b0e9cd1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:37.061831 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067c4c28-8201-4fe2-b8e4-72129b0e9cd1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:37.062572 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067c4c28-8201-4fe2-b8e4-72129b0e9cd1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:37.063001 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-067c4c28-8201-4fe2-b8e4-72129b0e9cd1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:37.138585 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-067c4c28-8201-4fe2-b8e4-72129b0e9cd1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087377 Jul 12 16:25:37.139217 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 289/565] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:25:37 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:37.933934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:37.934563 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:37.941139 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:37.941610 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:37.942436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:37.943527 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:38.149752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-5e5658d9-254f-4f96-aa2c-9edd2b91d342 req-82dcde19-69a6-422b-a618-a52e535fcd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78b6a91-9299-4181-925f-3967e7df03e5", "tag": "43e12ab9-8b98-4af6-b15a-f9f8a29deb09"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:38.157977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-5e5658d9-254f-4f96-aa2c-9edd2b91d342 req-82dcde19-69a6-422b-a618-a52e535fcd06 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:38.158617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-5e5658d9-254f-4f96-aa2c-9edd2b91d342 req-82dcde19-69a6-422b-a618-a52e535fcd06 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:38.171405 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-5e5658d9-254f-4f96-aa2c-9edd2b91d342 req-82dcde19-69a6-422b-a618-a52e535fcd06 service nova] Creating event network-changed:43e12ab9-8b98-4af6-b15a-f9f8a29deb09 for instance c78b6a91-9299-4181-925f-3967e7df03e5 on hv-cinder-79760 Jul 12 16:25:38.176422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-5e5658d9-254f-4f96-aa2c-9edd2b91d342 req-82dcde19-69a6-422b-a618-a52e535fcd06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030263 Jul 12 16:25:38.177582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 290/566] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:38.253253 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:38.261550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e7e0517e-86de-4bf4-8462-58d191833060 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1319 microversion: 2.1 time: 0.331388 Jul 12 16:25:38.262250 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 277/567] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:37 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:39.279185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:39.279985 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:39.286547 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:39.287081 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:39.287923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:39.288365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:39.422017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:39.430642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c2b7b256-e3a4-4a25-9453-6dd64bff5e55 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1319 microversion: 2.1 time: 0.155621 Jul 12 16:25:39.431408 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 291/568] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:39 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:40.447107 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:40.447725 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:40.454336 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:40.454786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:40.455549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:40.455984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:40.474902 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:40.513517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-60e4f869-2610-41df-8122-65833ab08476 req-135b1897-84ff-4eb5-af8a-10b4d9243a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441ac8f6-058b-49e7-83e3-b9d87be7f23c", "name": "network-vif-plugged", "status": "completed", "tag": "225e04e2-cbbb-475f-973d-9b8d6ff823ab"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:40.523370 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-60e4f869-2610-41df-8122-65833ab08476 req-135b1897-84ff-4eb5-af8a-10b4d9243a46 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:40.523953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-60e4f869-2610-41df-8122-65833ab08476 req-135b1897-84ff-4eb5-af8a-10b4d9243a46 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:40.538131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-60e4f869-2610-41df-8122-65833ab08476 req-135b1897-84ff-4eb5-af8a-10b4d9243a46 service nova] Creating event network-vif-plugged:225e04e2-cbbb-475f-973d-9b8d6ff823ab for instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c on hv-cinder-79760 Jul 12 16:25:40.543316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-60e4f869-2610-41df-8122-65833ab08476 req-135b1897-84ff-4eb5-af8a-10b4d9243a46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034110 Jul 12 16:25:40.543980 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 292/569] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:25:40.607865 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:40.615699 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4393b871-e84b-466d-bf64-3b3188d3037b tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1319 microversion: 2.1 time: 0.172379 Jul 12 16:25:40.616283 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 278/570] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:40 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:25:41.633581 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:41.634191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:41.640331 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:41.640777 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:41.641564 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:41.641991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:41.767826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:41.775200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-921729c1-c8af-44f4-aad3-d7889530447e tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1319 microversion: 2.1 time: 0.146608 Jul 12 16:25:41.775754 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 293/571] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:41 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:42.792104 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:42.792706 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:42.799208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:42.799645 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:42.800390 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:42.800817 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:42.926618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:25:42.934562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dedc24bc-77c0-47c0-9168-f8fc28b6806c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1507 microversion: 2.1 time: 0.146281 Jul 12 16:25:42.935125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 279/572] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:25:42 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:25:42.950826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-643d6ef1-36be-488f-a160-6800f6c584d4 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6dc64ce-5e9b-49b3-8104-6b7464d0de4c", "device": "/dev/sdb"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:42.952384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-643d6ef1-36be-488f-a160-6800f6c584d4 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:42.958359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-643d6ef1-36be-488f-a160-6800f6c584d4 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:42.958808 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-643d6ef1-36be-488f-a160-6800f6c584d4 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:42.959570 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-643d6ef1-36be-488f-a160-6800f6c584d4 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:42.960008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-643d6ef1-36be-488f-a160-6800f6c584d4 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:43.205588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-643d6ef1-36be-488f-a160-6800f6c584d4 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "POST /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258370 Jul 12 16:25:43.206195 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 294/573] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:25:42 2022] POST /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:52.380850 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-91ebbe05-087d-4da0-837a-859b5580a865 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "847a025c-81f1-4e7b-97c6-090f2f33933c"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:25:52.381991 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-91ebbe05-087d-4da0-837a-859b5580a865 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:52.383996 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:52.384850 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:52.385750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:52.392336 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91ebbe05-087d-4da0-837a-859b5580a865 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:52.392787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91ebbe05-087d-4da0-837a-859b5580a865 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:52.393572 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91ebbe05-087d-4da0-837a-859b5580a865 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:52.394013 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91ebbe05-087d-4da0-837a-859b5580a865 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:53.966434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-91ebbe05-087d-4da0-837a-859b5580a865 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.589397 Jul 12 16:25:53.967247 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 280/574] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:25:52 2022] POST /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments => generated 194 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:25:58.183131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-abf96c0b-15a4-4168-86a5-7e95916b0fa7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:58.183652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-abf96c0b-15a4-4168-86a5-7e95916b0fa7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:58.186058 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:58.187089 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=31 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:58.187799 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:58.194846 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abf96c0b-15a4-4168-86a5-7e95916b0fa7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:58.195302 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abf96c0b-15a4-4168-86a5-7e95916b0fa7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:58.196071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abf96c0b-15a4-4168-86a5-7e95916b0fa7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:58.196546 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-abf96c0b-15a4-4168-86a5-7e95916b0fa7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:58.228210 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-abf96c0b-15a4-4168-86a5-7e95916b0fa7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments/df3abac2-ce05-49a2-96df-725199e8940e" status: 200 len: 194 microversion: 2.20 time: 0.049560 Jul 12 16:25:58.228794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 295/575] 10.222.0.20 () {60 vars in 1453 bytes} [Tue Jul 12 16:25:58 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments/df3abac2-ce05-49a2-96df-725199e8940e => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:25:58.290814 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:58.291406 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:58.298448 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:58.298925 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:58.299688 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:58.300123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:58.378444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lazy-loading 'services' on Instance uuid c6459fa8-bfbc-40a1-af27-2d44bad65d98 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:25:58.449740 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e01a0e06-81a3-4a8c-b397-9d6b09ea4e2f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments/df3abac2-ce05-49a2-96df-725199e8940e" status: 202 len: 0 microversion: 2.20 time: 0.163660 Jul 12 16:25:58.450324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 281/576] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jul 12 16:25:58 2022] DELETE /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments/df3abac2-ce05-49a2-96df-725199e8940e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:25:58.459959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a8c1e330-0df9-46cf-ba99-1f077498081c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:58.461076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a8c1e330-0df9-46cf-ba99-1f077498081c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:58.467827 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8c1e330-0df9-46cf-ba99-1f077498081c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:58.468416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8c1e330-0df9-46cf-ba99-1f077498081c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:58.469346 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8c1e330-0df9-46cf-ba99-1f077498081c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:58.469832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a8c1e330-0df9-46cf-ba99-1f077498081c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:58.501105 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a8c1e330-0df9-46cf-ba99-1f077498081c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046370 Jul 12 16:25:58.501644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 296/577] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 16:25:58 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:25:59.513674 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b114c163-ef0e-4787-9d50-1990f63fe3ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:25:59.514759 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b114c163-ef0e-4787-9d50-1990f63fe3ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:25:59.521601 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b114c163-ef0e-4787-9d50-1990f63fe3ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:59.522053 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b114c163-ef0e-4787-9d50-1990f63fe3ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:59.522815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b114c163-ef0e-4787-9d50-1990f63fe3ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:25:59.523252 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b114c163-ef0e-4787-9d50-1990f63fe3ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:25:59.551715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b114c163-ef0e-4787-9d50-1990f63fe3ab tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042860 Jul 12 16:25:59.552280 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 282/578] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 16:25:59 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:26:00.563446 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a43a8661-d2f5-4d83-93ea-7925e86e5a8d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:00.564353 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a43a8661-d2f5-4d83-93ea-7925e86e5a8d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:00.570891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a43a8661-d2f5-4d83-93ea-7925e86e5a8d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:00.571359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a43a8661-d2f5-4d83-93ea-7925e86e5a8d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:00.572123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a43a8661-d2f5-4d83-93ea-7925e86e5a8d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:00.572554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a43a8661-d2f5-4d83-93ea-7925e86e5a8d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:00.602008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a43a8661-d2f5-4d83-93ea-7925e86e5a8d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042509 Jul 12 16:26:00.602581 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 297/579] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 16:26:00 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:26:01.468462 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:01.469428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:01.476317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.476769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.477561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.477996 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.500576 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lazy-loading 'flavor' on Instance uuid c565037f-2db4-4746-b8ff-c1e0fbe431df {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:26:01.615658 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0ca08d8c-a804-4501-b215-80615d9f49af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:01.617576 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0ca08d8c-a804-4501-b215-80615d9f49af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:01.625741 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0ca08d8c-a804-4501-b215-80615d9f49af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.626127 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0ca08d8c-a804-4501-b215-80615d9f49af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.626895 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0ca08d8c-a804-4501-b215-80615d9f49af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.627434 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0ca08d8c-a804-4501-b215-80615d9f49af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.637331 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-47a5b2bb-21c9-4113-b0a3-cf16fd844d5a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/action" status: 200 len: 32 microversion: 2.1 time: 0.172633 Jul 12 16:26:01.642055 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 283/580] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:26:01 2022] POST /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:26:01.648111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:01.648813 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:01.656004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.656483 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.657323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.657782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.663635 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0ca08d8c-a804-4501-b215-80615d9f49af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053521 Jul 12 16:26:01.664347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 298/581] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 16:26:01 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:26:01.721493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:01.721987 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:01.728512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.728958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.729776 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.730215 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.755763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:26:01.840746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1225754b-276f-4a98-9f4d-194b83fda78e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 204 len: 0 microversion: 2.20 time: 0.122794 Jul 12 16:26:01.841386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 299/582] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 16:26:01 2022] DELETE /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 16:26:01.849793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:01.850478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:01.856200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.856647 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.857444 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:01.857878 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:01.888757 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:01.897521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-734c467e-1f61-423c-be2c-5cf8943c307d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.253622 Jul 12 16:26:01.907610 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 284/583] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:01 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:26:01.986817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:01.995117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:01.996628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:01.997804 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6dad34c2-0425-4c2d-9d6f-ed7b8b3f94c1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.152147 Jul 12 16:26:01.998360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 300/584] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:01 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:02.493330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:02.493836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:02.500317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:02.500758 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:02.501582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:02.502013 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:02.581285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lazy-loading 'services' on Instance uuid 441ac8f6-058b-49e7-83e3-b9d87be7f23c {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:26:02.651931 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-45e438d7-98e2-42da-ab4b-2dc395c5c587 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "DELETE /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c/os-volume_attachments/a6dc64ce-5e9b-49b3-8104-6b7464d0de4c" status: 202 len: 0 microversion: 2.1 time: 0.162903 Jul 12 16:26:02.652500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 285/585] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:26:02 2022] DELETE /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c/os-volume_attachments/a6dc64ce-5e9b-49b3-8104-6b7464d0de4c => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:26:02.915141 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:02.915811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:02.922173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:02.922666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:02.923382 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:02.923831 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:03.016336 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:03.017035 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:03.023885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:03.024337 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:03.025121 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:03.025561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:03.056966 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:03.064989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-765ebf7a-ade9-4748-b88d-31415f9cbcbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.154269 Jul 12 16:26:03.065648 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 301/586] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:02 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:03.154384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:03.162396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:03.163943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:03.165196 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b16a0c25-7a5e-4df1-98cc-f3baefacbaa4 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.152985 Jul 12 16:26:03.165701 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 286/587] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:03 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:04.083431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:04.084180 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:04.090689 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.091208 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.092052 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.092485 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.189624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:04.191659 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:04.204001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.204502 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.205395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.206005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.287003 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:04.295084 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a2eb4545-f70c-4069-8762-bd7e5165e10a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.215947 Jul 12 16:26:04.295658 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 302/588] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:04 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:04.468895 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:04.477138 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:04.478691 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:04.479845 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-abb991e0-4c94-403c-ad82-004de81d0731 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1721 microversion: 2.20 time: 0.299747 Jul 12 16:26:04.480596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 287/589] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:04 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:26:04.812693 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:04.813248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:04.819659 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.820112 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.820875 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.821337 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.845694 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:26:04.924018 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-db7d9b84-c1aa-4224-b1c3-bc16b1c94f5b req-b8d4289c-06b5-407f-861e-1aa0be73cca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6459fa8-bfbc-40a1-af27-2d44bad65d98", "name": "network-vif-deleted", "tag": "2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:04.932202 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8711980d-f881-4f8c-a444-96a0a66dc0ed tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "DELETE /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 204 len: 0 microversion: 2.1 time: 0.122638 Jul 12 16:26:04.933730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 303/590] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:26:04 2022] DELETE /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:26:04.941951 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-db7d9b84-c1aa-4224-b1c3-bc16b1c94f5b req-b8d4289c-06b5-407f-861e-1aa0be73cca1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.943512 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-db7d9b84-c1aa-4224-b1c3-bc16b1c94f5b req-b8d4289c-06b5-407f-861e-1aa0be73cca1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.947462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:04.948373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:04.956276 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.956995 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.958071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:04.958668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:04.958784 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-db7d9b84-c1aa-4224-b1c3-bc16b1c94f5b req-b8d4289c-06b5-407f-861e-1aa0be73cca1 service nova] Creating event network-vif-deleted:2f0e3fda-d5ce-4be1-9fd4-2c9a73dcfad4 for instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 on hv-cinder-79760 Jul 12 16:26:04.963906 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-db7d9b84-c1aa-4224-b1c3-bc16b1c94f5b req-b8d4289c-06b5-407f-861e-1aa0be73cca1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051249 Jul 12 16:26:04.969964 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 288/591] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:26:05.312029 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:05.312718 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:05.321384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:05.322123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:05.324153 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:05.325322 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:05.354844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:05.362623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b7708a4c-e75f-4718-a125-e6ff3720878c tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1513 microversion: 2.1 time: 0.424439 Jul 12 16:26:05.363197 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 304/592] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:04 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1513 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:05.467444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:05.476003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8a6f621e-5b98-4f83-85c6-6aac8a193f2b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.168096 Jul 12 16:26:05.476606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 289/593] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:05 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:26:05.498631 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:05.499239 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:05.505212 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:05.505664 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:05.506439 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:05.506872 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:05.570116 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:05.578672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:05.580208 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:05.581368 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7f20a5e2-ee4e-4713-8416-a5c60fa415d1 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1367 microversion: 2.20 time: 0.086587 Jul 12 16:26:05.582130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 305/594] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:05 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:26:06.380658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:06.381298 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:06.387895 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:06.388377 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:06.389188 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:06.389647 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:06.495132 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:06.495958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:06.503652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:06.505225 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:06.506096 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:06.506903 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:06.528263 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:06.538411 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-385e3da0-af37-4eb0-be35-cc1288245ce6 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1513 microversion: 2.1 time: 0.162195 Jul 12 16:26:06.538994 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 290/595] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:06 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:06.600001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:06.600600 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:06.606672 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:06.607112 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:06.607877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:06.608323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:06.612981 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:06.646380 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:06.646810 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:06.647263 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lazy-loading 'fault' on Instance uuid c6459fa8-bfbc-40a1-af27-2d44bad65d98 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:26:06.650265 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:06.658476 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-109b53f3-c501-46b7-897f-6432d4bd56cb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.167622 Jul 12 16:26:06.659043 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 306/596] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:06 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:06.694731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:06.702754 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:06.704275 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:06.705431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d8fd86bc-6cd5-4673-ab7d-17efaf8ff473 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 200 len: 1372 microversion: 2.20 time: 0.109624 Jul 12 16:26:06.709083 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 291/597] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:06 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:07.353360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-9014d492-52dc-45e7-b5e5-26232e9029db req-1e24fb47-a059-4c64-9568-17abd4f92170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441ac8f6-058b-49e7-83e3-b9d87be7f23c", "name": "network-vif-deleted", "tag": "225e04e2-cbbb-475f-973d-9b8d6ff823ab"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:07.361923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-9014d492-52dc-45e7-b5e5-26232e9029db req-1e24fb47-a059-4c64-9568-17abd4f92170 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.362369 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-9014d492-52dc-45e7-b5e5-26232e9029db req-1e24fb47-a059-4c64-9568-17abd4f92170 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.373314 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-9014d492-52dc-45e7-b5e5-26232e9029db req-1e24fb47-a059-4c64-9568-17abd4f92170 service nova] Creating event network-vif-deleted:225e04e2-cbbb-475f-973d-9b8d6ff823ab for instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c on hv-cinder-79760 Jul 12 16:26:07.378385 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-9014d492-52dc-45e7-b5e5-26232e9029db req-1e24fb47-a059-4c64-9568-17abd4f92170 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029200 Jul 12 16:26:07.378974 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 307/598] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:07.555094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:07.555683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:07.562069 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.562543 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.563296 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.563727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.595898 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.596342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.596787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lazy-loading 'fault' on Instance uuid 441ac8f6-058b-49e7-83e3-b9d87be7f23c {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:26:07.636728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d0db5db4e647c8ae5edef6c435923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d93a63cf174aa9b006723dd55a523c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:07.644037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4cabdf86-ff04-4b60-a409-765b3076fe16 tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 200 len: 1309 microversion: 2.1 time: 0.092744 Jul 12 16:26:07.644590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 292/599] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:07 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:07.676084 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:07.676852 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:07.682945 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.683393 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.684144 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.684577 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.723916 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:07.724135 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:07.730387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.730834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.731602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:07.732137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:07.745916 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] HTTP exception thrown: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Request method failure captured: Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 HTTP/1.1 Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kpBY8mfWm5SbswA_twWwWmKiY0c54kyPojGAMXXJLDy-wIIlnEB60qyWukF1Q4Ubq2EKu_wkRLawsgncGzPKSfr0FSo4OzhALGlHZUHveONVK9YGVLn8qeenCpfSWUSufu_8q6HmfAZRoGdi_zaTqnSgBbHNynC21vlgCR2zZ9io Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:26:07.747577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77ed8271e0d44de688f86520aa923c60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: e718e7f4f8974ff59151b87aef603a09 Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:26:07.748980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'c6459fa8-bfbc-40a1-af27-2d44bad65d98'} Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:26:07.749834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:26:07.751022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:07.752125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Returning 404 to user: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:26:07.752125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9154a5f2-6074-4407-9908-1648a0952ed6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 404 len: 111 microversion: 2.20 time: 0.029336 Jul 12 16:26:07.752125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 293/600] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:07 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 16:26:07.758415 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8e9f6d32-b1ad-4878-8eeb-cf74750d52df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '.version_select at 0x7f1da59f05e0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:07.780404 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8e9f6d32-b1ad-4878-8eeb-cf74750d52df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612418878" status: 204 len: 0 microversion: 2.20 time: 0.026278 Jul 12 16:26:07.780978 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 294/601] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Jul 12 16:26:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612418878 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 16:26:07.821508 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:07.826355 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:07.835479 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-87652f87-64bf-40ca-ba15-ff9cd7d291de tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.163940 Jul 12 16:26:07.836300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 308/602] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:07 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:08.405895 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b6242113-6f84-4061-a23a-90ef7bc7c288 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'create', calling method: .version_select at 0x7f1da59d9d30>, body: {"keypair": {"name": "tempest-keypair-1516095789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtIHITht55VGoMF0OuttHjK6Wob8B3LZmWvOf1qKFl/cw1DTPGUGlfQpBvtKYoTFasmzIUqL773jgz7YBqZItfGzIPQgjUEc0zEF+f55ZBAv2K7uV472SEXu6mqdhNWrA=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:08.420893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-b6242113-6f84-4061-a23a-90ef7bc7c288 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for project 77ed8271e0d44de688f86520aa923c60. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:26:08.424660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-b6242113-6f84-4061-a23a-90ef7bc7c288 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for user e718e7f4f8974ff59151b87aef603a09 and project 77ed8271e0d44de688f86520aa923c60. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:26:08.446028 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b6242113-6f84-4061-a23a-90ef7bc7c288 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044100 Jul 12 16:26:08.446597 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 295/603] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jul 12 16:26:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 16:26:08.662197 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:08.662812 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] [instance: 441ac8f6-058b-49e7-83e3-b9d87be7f23c] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:08.669991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:08.670436 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:08.671231 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:08.671667 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:08.687112 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] HTTP exception thrown: Instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c could not be found. Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Request method failure captured: Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c HTTP/1.1 Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaAospzr-s5vrxOZYpelIXeCXKXKYpbUklSHQ2M7wEaReB7hrF9EuSeeEQHgkTZi9_vH5yRSkuR96_eEUkbEifR0FAwobKYQ65qx_hXSB0EIv4IoeBZCCOn22L9kv66zGMuuUnzyPGd9ogEf4CylRj6easELPsgLCLQ4nfKqEhIT8sU Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 16d93a63cf174aa9b006723dd55a523c Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesSnapshotTestJSON-179462763 Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:26:08.689021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16d93a63cf174aa9b006723dd55a523c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16d93a63cf174aa9b006723dd55a523c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16d93a63cf174aa9b006723dd55a523c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16d93a63cf174aa9b006723dd55a523c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesSnapshotTestJSON-179462763 Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 16d93a63cf174aa9b006723dd55a523c Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-179462763 Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesSnapshotTestJSON-179462763-project Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: a9d0db5db4e647c8ae5edef6c435923c Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesSnapshotTestJSON-179462763-project Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c could not be found. Jul 12 16:26:08.690518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '441ac8f6-058b-49e7-83e3-b9d87be7f23c'} Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c could not be found. Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:26:08.694554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c could not be found. Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c could not be found. Jul 12 16:26:08.695842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:08.696867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] Returning 404 to user: Instance 441ac8f6-058b-49e7-83e3-b9d87be7f23c could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:26:08.696867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-64e3dbbd-1d21-4f76-93a2-0cf97e9a9bce tempest-VolumesSnapshotTestJSON-179462763 tempest-VolumesSnapshotTestJSON-179462763-project] 10.222.0.20 "GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c" status: 404 len: 111 microversion: 2.1 time: 0.033128 Jul 12 16:26:08.696867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 309/604] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:08 2022] GET /compute/v2.1/servers/441ac8f6-058b-49e7-83e3-b9d87be7f23c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:26:08.854030 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:08.854795 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:08.862307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:08.863207 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:08.864010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:08.864441 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:09.107132 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:09.115298 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b3c404b9-a636-4e63-8743-3103e93f30b7 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.266861 Jul 12 16:26:09.115860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 296/605] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:08 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:09.804239 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-941117363", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9219161c-1505-4bdd-bd5a-586550da37d0"}], "security_groups": [{"name": "tempest-securitygroup--1477488672"}], "key_name": "tempest-keypair-1516095789", "user_data": "}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:09.903232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] validate_networks() for [('9219161c-1505-4bdd-bd5a-586550da37d0', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:26:10.132394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:10.133037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:10.140030 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:10.140777 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:10.142263 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:10.142953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:10.291019 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:10.292729 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:26:10.293186 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:26:10.293661 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:26:10.294078 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:26:10.294490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:26:10.299271 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8c2b78c6-aae6-4954-b2bc-09db79c9c460 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.170811 Jul 12 16:26:10.299943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 297/606] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:10 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:26:10.303429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:10.303868 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:10.304668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:10.305125 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:10.321736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for project 77ed8271e0d44de688f86520aa923c60. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:26:10.326076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Getting quotas for user e718e7f4f8974ff59151b87aef603a09 and project 77ed8271e0d44de688f86520aa923c60. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:26:10.337682 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:26:10.339979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:26:10.385939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-388b0f87-5390-4620-a710-9319539c3d15 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.586096 Jul 12 16:26:10.386583 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 310/607] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jul 12 16:26:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 16:26:10.397412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b06bb40e-bdcb-49ef-bf8a-bcf0136321d3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:10.398125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b06bb40e-bdcb-49ef-bf8a-bcf0136321d3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:10.452576 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b06bb40e-bdcb-49ef-bf8a-bcf0136321d3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:10.460526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b06bb40e-bdcb-49ef-bf8a-bcf0136321d3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:10.462055 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b06bb40e-bdcb-49ef-bf8a-bcf0136321d3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:10.463140 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b06bb40e-bdcb-49ef-bf8a-bcf0136321d3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1281 microversion: 2.20 time: 0.070324 Jul 12 16:26:10.463698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 298/608] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:10 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:26:11.316140 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:11.317426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:11.324765 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:11.325249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:11.326228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:11.326470 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:11.457789 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:11.465504 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6d751ad3-3c62-4770-98bc-901ecb2ab7ce tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.153693 Jul 12 16:26:11.466050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 311/609] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:11 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:11.480124 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:11.480730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:11.487548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:11.487991 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:11.489351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:11.489778 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:11.549118 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:11.557619 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:11.559130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:11.560225 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-81aef7e7-7c6f-4dd0-97f5-4f8b23b3890e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1285 microversion: 2.20 time: 0.084123 Jul 12 16:26:11.560783 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 299/610] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:11 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:26:12.482856 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:12.483407 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:12.490741 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:12.491188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:12.491950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:12.492387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:12.577422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:12.578042 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:12.584522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:12.584972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:12.585772 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:12.586209 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:12.618545 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:12.626534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-746c7044-3cdb-4fb4-85af-aa7c16671938 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.147584 Jul 12 16:26:12.627108 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 312/611] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:12 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:12.648122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:12.655911 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:12.657461 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:12.658541 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ee2887e9-2f89-44d8-920c-67638e77e6eb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1277 microversion: 2.20 time: 0.084988 Jul 12 16:26:12.659094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 300/612] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:12 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:13.645644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:13.646959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:13.653250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:13.653934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:13.654709 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:13.655145 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:13.676878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:13.678792 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:13.686024 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:13.686470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:13.687227 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:13.687655 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:13.748592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:13.757463 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:13.759279 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:13.760301 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0814573e-6217-4026-8ff0-fa515104c09d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1339 microversion: 2.20 time: 0.088000 Jul 12 16:26:13.760849 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 301/613] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:13 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:26:13.798336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:13.808768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1fcd51de-0fc4-47a3-9fe2-0300e2587ebb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.166209 Jul 12 16:26:13.809597 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 313/614] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:13 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:14.789367 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:14.790081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:14.796551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:14.797004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:14.797809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:14.798246 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:14.826847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:14.828185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:14.834915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:14.835404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:14.836267 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:14.836869 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:14.973934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:14.982557 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9ec2eb3f-9015-4c1e-817b-96c1ab56ff2e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.159585 Jul 12 16:26:14.983133 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 314/615] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:14 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:15.018928 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:15.036289 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:15.039297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:15.040613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-633ee39e-aeb3-4622-8da2-8b16999a0bd6 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.265494 Jul 12 16:26:15.041388 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 302/616] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:14 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:26:15.256475 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-9c5b29a0-10ad-40ca-a839-3fcfe2204726 req-5be6646e-69d6-4c66-bd7b-de1c02f4c70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e", "tag": "77b11a6f-6e1f-4b01-ab67-32247582df08"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:15.271084 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-9c5b29a0-10ad-40ca-a839-3fcfe2204726 req-5be6646e-69d6-4c66-bd7b-de1c02f4c70e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:15.271896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-9c5b29a0-10ad-40ca-a839-3fcfe2204726 req-5be6646e-69d6-4c66-bd7b-de1c02f4c70e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:15.288879 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-9c5b29a0-10ad-40ca-a839-3fcfe2204726 req-5be6646e-69d6-4c66-bd7b-de1c02f4c70e service nova] Creating event network-changed:77b11a6f-6e1f-4b01-ab67-32247582df08 for instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e on hv-cinder-79760 Jul 12 16:26:15.296322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-9c5b29a0-10ad-40ca-a839-3fcfe2204726 req-5be6646e-69d6-4c66-bd7b-de1c02f4c70e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043916 Jul 12 16:26:15.297119 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 315/617] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:16.000219 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:16.000904 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:16.009840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:16.010179 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:16.019481 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:16.019481 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:16.063639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:16.064400 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:16.072303 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:16.072754 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:16.073556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:16.073991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:16.162067 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:16.170103 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8c812ff9-cb52-4b25-a6c1-7f71c5c34dd9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.173920 Jul 12 16:26:16.170673 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 303/618] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:15 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:16.204440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:16.212339 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:16.213882 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:16.214972 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-52ca7b28-1e7b-40a6-8715-4ec1c034dc43 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.159566 Jul 12 16:26:16.215523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 316/619] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:16 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:17.187576 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:17.188193 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:17.195117 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:17.195614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:17.196476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:17.196940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:17.231650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:17.232857 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:17.239615 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:17.240359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:17.241379 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:17.242009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:17.343244 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:17.351257 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1bd7a7ae-116f-4409-b71d-3576a2216391 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.167472 Jul 12 16:26:17.351833 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 304/620] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:17 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:17.382848 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:17.390572 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:17.392072 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:17.393177 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-79b4399c-c772-47cc-97c1-5cfcc64b2eb0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.165414 Jul 12 16:26:17.393726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 317/621] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:17 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:18.367710 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:18.368323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:18.374843 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:18.375291 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:18.376046 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:18.376483 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:18.411860 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:18.412852 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:18.419365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:18.419808 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:18.420561 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:18.420988 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:18.502022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:18.509917 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ea37fc63-acd3-46c3-8df9-939a98a14b39 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.145982 Jul 12 16:26:18.510487 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 305/622] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:18 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:18.548151 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:18.555963 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:18.557496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:18.558574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f4cc5cd8-ba21-4d6a-8fcd-fab444236174 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.151152 Jul 12 16:26:18.559134 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 318/623] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:18 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:19.526871 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:19.527749 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:19.534507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:19.534955 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:19.535723 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:19.536161 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:19.576058 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:19.576672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:19.583843 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:19.584378 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:19.585100 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:19.585511 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:19.676679 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:19.684624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fefbe71a-bfc4-404b-a1fb-a9abc589099a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.161613 Jul 12 16:26:19.685216 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 306/624] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:19 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:19.719210 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:19.726951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:19.728469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:19.729624 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f9a66bdd-a2c7-4aec-a2b5-4fe2072a10e7 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.157403 Jul 12 16:26:19.730176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 319/625] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:19 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:20.702039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:20.702641 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:20.704600 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:20.711195 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:20.711638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:20.712424 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:20.712856 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:20.747744 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:20.748351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:20.750713 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:20.751577 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=6 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:20.757698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:20.758223 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:20.759433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:20.760127 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:20.853582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:20.862186 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c7866835-c7e9-4b2d-8fee-7bf211b74b06 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.164018 Jul 12 16:26:20.862747 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 307/626] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:20 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:20.896820 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:20.904800 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:20.906352 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:20.907457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-63451453-8f23-4ef9-bae4-9e90fab618c2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.163628 Jul 12 16:26:20.908022 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 320/627] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:20 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:21.880044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:21.880602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:21.886900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:21.887346 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:21.888099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:21.888530 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:21.925997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:21.926665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:21.933155 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:21.933609 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:21.934384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:21.934821 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:22.019086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:22.028023 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c3bcc9bd-ad56-4a78-8086-ea897bc2df6c tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.152416 Jul 12 16:26:22.028599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 308/628] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:21 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:22.036213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-84512ef4-192a-4fff-a9e3-3cb0e5ac8b81 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:22.036213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-84512ef4-192a-4fff-a9e3-3cb0e5ac8b81 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:22.039604 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84512ef4-192a-4fff-a9e3-3cb0e5ac8b81 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:22.040125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84512ef4-192a-4fff-a9e3-3cb0e5ac8b81 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:22.040911 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84512ef4-192a-4fff-a9e3-3cb0e5ac8b81 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:22.041375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84512ef4-192a-4fff-a9e3-3cb0e5ac8b81 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:22.064389 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-84512ef4-192a-4fff-a9e3-3cb0e5ac8b81 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/ips" status: 200 len: 150 microversion: 2.1 time: 0.034747 Jul 12 16:26:22.064946 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:22.065115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 309/629] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:26:22 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:22.073933 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:22.075957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:22.077287 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-88408df3-2261-48ac-bfbb-0dde37460b4b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.155137 Jul 12 16:26:22.078026 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 321/630] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:21 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:22.679646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-b1db75e0-cf5c-44a6-ada6-f6a62b0e7a40 req-e68b9c00-5c6c-4a0a-baea-41408aadf2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e", "name": "network-vif-plugged", "status": "completed", "tag": "77b11a6f-6e1f-4b01-ab67-32247582df08"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:22.683338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:22.689207 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b1db75e0-cf5c-44a6-ada6-f6a62b0e7a40 req-e68b9c00-5c6c-4a0a-baea-41408aadf2e4 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:22.689644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b1db75e0-cf5c-44a6-ada6-f6a62b0e7a40 req-e68b9c00-5c6c-4a0a-baea-41408aadf2e4 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:22.702976 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-b1db75e0-cf5c-44a6-ada6-f6a62b0e7a40 req-e68b9c00-5c6c-4a0a-baea-41408aadf2e4 service nova] Creating event network-vif-plugged:77b11a6f-6e1f-4b01-ab67-32247582df08 for instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e on hv-cinder-79760 Jul 12 16:26:22.708983 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-b1db75e0-cf5c-44a6-ada6-f6a62b0e7a40 req-e68b9c00-5c6c-4a0a-baea-41408aadf2e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Jul 12 16:26:22.708983 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 310/631] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:23.045042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:23.045632 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:23.052067 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:23.052576 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:23.053361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:23.053796 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:23.096738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:23.097540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:23.104312 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:23.104754 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:23.105540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:23.105995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:23.190149 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:23.198798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-52450bc7-949f-4e0e-a66c-dc0a92cf36f2 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.157715 Jul 12 16:26:23.199364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 322/632] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:23 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:23.242158 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:23.245880 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:23.251147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:23.252663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:23.253792 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6f4c6e1f-0ebf-4811-bbbe-57a9ca0199c0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.161800 Jul 12 16:26:23.254920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 311/633] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:23 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:23.376627 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-34521b69-758b-44dd-b188-ee3acee560bb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "527dcec5-838e-4f9e-9a66-130ed6afb8d0"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:23.377725 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-34521b69-758b-44dd-b188-ee3acee560bb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:23.384246 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-34521b69-758b-44dd-b188-ee3acee560bb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:23.384700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-34521b69-758b-44dd-b188-ee3acee560bb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:23.385489 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-34521b69-758b-44dd-b188-ee3acee560bb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:23.385932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-34521b69-758b-44dd-b188-ee3acee560bb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:23.862609 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-34521b69-758b-44dd-b188-ee3acee560bb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489718 Jul 12 16:26:23.863752 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 323/634] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:26:23 2022] POST /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:24.216614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:24.217275 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:24.224636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:24.225106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:24.225863 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:24.226294 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:24.272975 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:24.273587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:24.279788 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:24.280238 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:24.281010 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:24.281473 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:24.360735 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:24.370014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b721167d-b3fa-48c0-8442-7bbd6631e746 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.157513 Jul 12 16:26:24.370581 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 312/635] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:24 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:24.417685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:24.425468 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:24.427013 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:24.428097 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f5f46353-5946-4b4f-bdcc-5a8f169aae48 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1407 microversion: 2.20 time: 0.160061 Jul 12 16:26:24.428650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 324/636] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:24 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:25.388020 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:25.388628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:25.395078 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:25.395523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:25.396275 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:25.396705 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:25.446580 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:25.447186 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:25.454103 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:25.454553 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:25.455325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:25.455760 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:25.526583 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:25.534473 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4e1005b0-89da-45ce-b3c4-ee71cefdf6e5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.150659 Jul 12 16:26:25.535561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 313/637] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:25 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:25.584899 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:25.592667 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:25.594207 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:25.595330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ef2404b2-5546-455a-8006-e60cceb78577 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1598 microversion: 2.20 time: 0.152721 Jul 12 16:26:25.595880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 325/638] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:26:25 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:26:25.613833 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-68f883ad-c33c-4a70-a8b7-ede346255889 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:25.614366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-68f883ad-c33c-4a70-a8b7-ede346255889 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:25.620218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68f883ad-c33c-4a70-a8b7-ede346255889 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:25.620660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68f883ad-c33c-4a70-a8b7-ede346255889 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:25.621438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68f883ad-c33c-4a70-a8b7-ede346255889 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:25.621867 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68f883ad-c33c-4a70-a8b7-ede346255889 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:25.699141 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-68f883ad-c33c-4a70-a8b7-ede346255889 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089959 Jul 12 16:26:25.699735 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 314/639] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jul 12 16:26:25 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:26:26.551793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:26.552397 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:26.558839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:26.559288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:26.560044 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:26.560477 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:26.564463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:26.678245 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-1d7d5f25-5f9d-42ed-bdfc-15d7dfaa2647 req-6ae67edf-ff4a-4944-bed8-a46f369b1bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e", "tag": "77b11a6f-6e1f-4b01-ab67-32247582df08"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:26.688055 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1d7d5f25-5f9d-42ed-bdfc-15d7dfaa2647 req-6ae67edf-ff4a-4944-bed8-a46f369b1bba service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:26.688499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1d7d5f25-5f9d-42ed-bdfc-15d7dfaa2647 req-6ae67edf-ff4a-4944-bed8-a46f369b1bba service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:26.697452 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:26.703334 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-1d7d5f25-5f9d-42ed-bdfc-15d7dfaa2647 req-6ae67edf-ff4a-4944-bed8-a46f369b1bba service nova] Creating event network-changed:77b11a6f-6e1f-4b01-ab67-32247582df08 for instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e on hv-cinder-79760 Jul 12 16:26:26.706605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3acffa91-755f-4d59-a9a5-17c2bec096c5 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1733 microversion: 2.1 time: 0.158656 Jul 12 16:26:26.707429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 326/640] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:26 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:26:26.708646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-1d7d5f25-5f9d-42ed-bdfc-15d7dfaa2647 req-6ae67edf-ff4a-4944-bed8-a46f369b1bba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Jul 12 16:26:26.709603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 315/641] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:26:27.724275 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:27.725287 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:27.733647 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:27.734174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:27.735050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:27.735556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:27.875032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:27.883943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-348ed556-33d9-46b8-97bd-508cb74fe9e0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1713 microversion: 2.1 time: 0.163964 Jul 12 16:26:27.884531 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 327/642] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:27 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:27.987663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:27.988269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:27.994419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:27.994869 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:27.995619 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:27.996053 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:28.076544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] HTTP exception thrown: Cannot 'detach_volume' instance c565037f-2db4-4746-b8ff-c1e0fbe431df while it is in vm_state rescued Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Request method failure captured: Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments/847a025c-81f1-4e7b-97c6-090f2f33933c HTTP/1.1 Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-m9H521Lwot7C4VNMRpEa_HUy-NTX4_b9y9l4PuZqmXLZcsqAcUQ7bUOxpW-oJ1ajmPFEx6GutFRwqjlevwHRXxsSy4gOu7W-XULrDyEP1Pp9N6W7sXsyolvNC1rEUUf2Ck_xXjAgGHAR-EVynuAvnUFGyUaD0j3ZJVxbqHFT67xM Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:26:28.078184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_641dd5eac4cf4352924c1610407bc5e3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: e980def45e934114a2f0bc7081ffe8e3 Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:26:28.079551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Cannot 'detach_volume' instance c565037f-2db4-4746-b8ff-c1e0fbe431df while it is in vm_state rescued Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'server_id': 'c565037f-2db4-4746-b8ff-c1e0fbe431df', 'id': '847a025c-81f1-4e7b-97c6-090f2f33933c'} Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c565037f-2db4-4746-b8ff-c1e0fbe431df in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:26:28.080213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c565037f-2db4-4746-b8ff-c1e0fbe431df while it is in vm_state rescued Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c565037f-2db4-4746-b8ff-c1e0fbe431df while it is in vm_state rescued Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:26:28.081489 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Returning 409 to user: Cannot 'detach_volume' instance c565037f-2db4-4746-b8ff-c1e0fbe431df while it is in vm_state rescued {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:26:28.083154 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-82c241b5-1ad3-49d8-83a7-9cc65e286dbb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments/847a025c-81f1-4e7b-97c6-090f2f33933c" status: 409 len: 152 microversion: 2.1 time: 0.097027 Jul 12 16:26:28.083154 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 316/643] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:26:27 2022] DELETE /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments/847a025c-81f1-4e7b-97c6-090f2f33933c => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 16:26:28.088762 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e0325543-04e3-4dc5-bd13-b7f8182da524 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:28.089325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e0325543-04e3-4dc5-bd13-b7f8182da524 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:28.095236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0325543-04e3-4dc5-bd13-b7f8182da524 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:28.095689 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0325543-04e3-4dc5-bd13-b7f8182da524 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:28.096490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0325543-04e3-4dc5-bd13-b7f8182da524 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:28.096931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e0325543-04e3-4dc5-bd13-b7f8182da524 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:28.161141 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e0325543-04e3-4dc5-bd13-b7f8182da524 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "POST /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/action" status: 202 len: 0 microversion: 2.1 time: 0.075959 Jul 12 16:26:28.161768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 328/644] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:26:28 2022] POST /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:26:28.169699 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:28.170312 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:28.176910 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:28.177651 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:28.178526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:28.178877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:28.397164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:28.405190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-48d6e9b3-5330-479d-927e-b2d3e36611eb tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1721 microversion: 2.1 time: 0.239238 Jul 12 16:26:28.405753 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 317/645] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:28 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:26:29.424585 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:29.425316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:29.427217 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:29.432741 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:29.433220 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:29.433986 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:29.434420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:29.565749 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:29.574034 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4d8254f7-a804-48c2-8d77-e4ce0cc6d67b tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1721 microversion: 2.1 time: 0.154221 Jul 12 16:26:29.574589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 329/646] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:29 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:30.591613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:30.592162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:30.599181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:30.599627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:30.600376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:30.600809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:30.740915 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:30.751045 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-13e224a8-ffb0-432b-bbef-871d03eeda67 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1721 microversion: 2.1 time: 0.163319 Jul 12 16:26:30.751698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 318/647] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:30 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:31.771157 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:31.771798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:31.778056 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:31.778500 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:31.779259 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:31.779721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:31.917730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:31.926032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b8b4f0f9-ca65-4f2d-8053-730010f848cf tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1727 microversion: 2.1 time: 0.158358 Jul 12 16:26:31.926603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 330/648] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:31 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:31.942964 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0eecf50a-b95d-409d-afe3-9725578030ad tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:31.943517 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0eecf50a-b95d-409d-afe3-9725578030ad tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:31.949809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0eecf50a-b95d-409d-afe3-9725578030ad tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:31.950253 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0eecf50a-b95d-409d-afe3-9725578030ad tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:31.951036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0eecf50a-b95d-409d-afe3-9725578030ad tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:31.951588 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0eecf50a-b95d-409d-afe3-9725578030ad tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:32.030103 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0eecf50a-b95d-409d-afe3-9725578030ad tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091700 Jul 12 16:26:32.033971 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 319/649] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:26:31 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:32.451491 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "527dcec5-838e-4f9e-9a66-130ed6afb8d0"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:32.452819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:32.459289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:32.459806 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:32.460639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:32.461334 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:32.547152 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Invalid volume: volume 527dcec5-838e-4f9e-9a66-130ed6afb8d0 is already attached to instances: c78b6a91-9299-4181-925f-3967e7df03e5 Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: POST /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments HTTP/1.1 Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 74 Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:26:32.548855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {"volumeAttachment": {"volumeId": "527dcec5-838e-4f9e-9a66-130ed6afb8d0"}} Jul 12 16:26:32.550171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Invalid volume: volume 527dcec5-838e-4f9e-9a66-130ed6afb8d0 is already attached to instances: c78b6a91-9299-4181-925f-3967e7df03e5 Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'server_id': 'c78b6a91-9299-4181-925f-3967e7df03e5', 'body': {'volumeAttachment': {'volumeId': '527dcec5-838e-4f9e-9a66-130ed6afb8d0'}}} Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 527dcec5-838e-4f9e-9a66-130ed6afb8d0 is already attached to instances: c78b6a91-9299-4181-925f-3967e7df03e5 Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:32.551498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 527dcec5-838e-4f9e-9a66-130ed6afb8d0 is already attached to instances: c78b6a91-9299-4181-925f-3967e7df03e5 Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:32.553305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 527dcec5-838e-4f9e-9a66-130ed6afb8d0 is already attached to instances: c78b6a91-9299-4181-925f-3967e7df03e5 Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 400 to user: Invalid volume: volume 527dcec5-838e-4f9e-9a66-130ed6afb8d0 is already attached to instances: c78b6a91-9299-4181-925f-3967e7df03e5 {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d32ca84a-db44-44b1-a417-cd603e9ce0eb tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103074 Jul 12 16:26:32.555229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 331/650] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:26:32 2022] POST /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:26:32.625018 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:32.625789 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:32.633164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:32.633872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:32.634983 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:32.635639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:32.729814 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lazy-loading 'services' on Instance uuid c78b6a91-9299-4181-925f-3967e7df03e5 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:26:32.819794 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-78ca94b8-6d6c-4805-8c50-16fe0a8e51c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments/527dcec5-838e-4f9e-9a66-130ed6afb8d0" status: 202 len: 0 microversion: 2.1 time: 0.198703 Jul 12 16:26:32.820490 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 320/651] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:26:32 2022] DELETE /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments/527dcec5-838e-4f9e-9a66-130ed6afb8d0 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:26:32.829315 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-bbf59315-9c4d-4131-961b-3ce40f7cfb50 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:32.831266 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-bbf59315-9c4d-4131-961b-3ce40f7cfb50 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:32.839483 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bbf59315-9c4d-4131-961b-3ce40f7cfb50 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:32.840042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bbf59315-9c4d-4131-961b-3ce40f7cfb50 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:32.840899 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bbf59315-9c4d-4131-961b-3ce40f7cfb50 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:32.841467 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bbf59315-9c4d-4131-961b-3ce40f7cfb50 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:32.878783 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-bbf59315-9c4d-4131-961b-3ce40f7cfb50 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053751 Jul 12 16:26:32.879433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 332/652] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:26:32 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:26:33.065287 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-e464a8be-fbc6-4704-8b6f-643069e05b6a req-fdc0967f-f281-45a9-85f1-30a3bd82433b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c565037f-2db4-4746-b8ff-c1e0fbe431df", "tag": "b10043d7-6d3e-46b6-b837-b811a5e4b22a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:33.074769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e464a8be-fbc6-4704-8b6f-643069e05b6a req-fdc0967f-f281-45a9-85f1-30a3bd82433b service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:33.075379 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e464a8be-fbc6-4704-8b6f-643069e05b6a req-fdc0967f-f281-45a9-85f1-30a3bd82433b service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:33.088664 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-e464a8be-fbc6-4704-8b6f-643069e05b6a req-fdc0967f-f281-45a9-85f1-30a3bd82433b service nova] Creating event network-changed:b10043d7-6d3e-46b6-b837-b811a5e4b22a for instance c565037f-2db4-4746-b8ff-c1e0fbe431df on hv-cinder-79760 Jul 12 16:26:33.093729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-e464a8be-fbc6-4704-8b6f-643069e05b6a req-fdc0967f-f281-45a9-85f1-30a3bd82433b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032893 Jul 12 16:26:33.094836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 321/653] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:33.892820 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-07d00e5f-07ac-4fdf-8b06-88e166f9239f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:33.897004 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-07d00e5f-07ac-4fdf-8b06-88e166f9239f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:33.908885 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-07d00e5f-07ac-4fdf-8b06-88e166f9239f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:33.909639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-07d00e5f-07ac-4fdf-8b06-88e166f9239f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:33.911536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-07d00e5f-07ac-4fdf-8b06-88e166f9239f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:33.912662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-07d00e5f-07ac-4fdf-8b06-88e166f9239f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:33.966617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-07d00e5f-07ac-4fdf-8b06-88e166f9239f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079725 Jul 12 16:26:33.967229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 333/654] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:26:33 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:26:34.032732 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:34.033349 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:34.040346 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:34.040792 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:34.041787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:34.042228 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:34.074919 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:26:34.167032 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-80ec320b-bdec-4adc-9352-5854c5303bc3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 204 len: 0 microversion: 2.1 time: 0.137892 Jul 12 16:26:34.167736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 322/655] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:26:34 2022] DELETE /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:26:34.178441 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:34.179332 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:34.186458 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:34.187115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:34.188033 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:34.188626 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:34.417167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:34.432319 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5f379a43-738a-4f94-9175-578492c632ba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1681 microversion: 2.1 time: 0.257997 Jul 12 16:26:34.443836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 334/656] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:34 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:35.109717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-335bf346-e6ae-4ba2-acfa-17774f713eb5 req-53f7358a-7039-4664-a904-6fcca1761f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c565037f-2db4-4746-b8ff-c1e0fbe431df", "tag": "b10043d7-6d3e-46b6-b837-b811a5e4b22a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:35.119805 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-335bf346-e6ae-4ba2-acfa-17774f713eb5 req-53f7358a-7039-4664-a904-6fcca1761f88 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:35.120252 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-335bf346-e6ae-4ba2-acfa-17774f713eb5 req-53f7358a-7039-4664-a904-6fcca1761f88 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:35.132358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-335bf346-e6ae-4ba2-acfa-17774f713eb5 req-53f7358a-7039-4664-a904-6fcca1761f88 service nova] Creating event network-changed:b10043d7-6d3e-46b6-b837-b811a5e4b22a for instance c565037f-2db4-4746-b8ff-c1e0fbe431df on hv-cinder-79760 Jul 12 16:26:35.137587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-335bf346-e6ae-4ba2-acfa-17774f713eb5 req-53f7358a-7039-4664-a904-6fcca1761f88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032176 Jul 12 16:26:35.138100 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 323/657] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:35.453473 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:35.453999 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:35.462813 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:35.463257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:35.464019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:35.465491 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:35.642399 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:35.659676 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-adb8ae71-ccaf-494b-ad60-7cc03848b05d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1681 microversion: 2.1 time: 0.210165 Jul 12 16:26:35.660996 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 335/658] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:35 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:36.678581 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:36.679399 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:36.686517 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:36.687259 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:36.688402 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:36.688907 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:37.317731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:37.332904 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4d145fd7-13fe-4dd4-8d3f-548201c68256 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1681 microversion: 2.1 time: 0.656058 Jul 12 16:26:37.338827 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 324/659] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:36 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1681 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:38.030831 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-13047d45-215b-4119-b313-8980d097d22a req-c1baff38-c55b-4873-8d9f-d59df4341c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78b6a91-9299-4181-925f-3967e7df03e5", "name": "network-vif-deleted", "tag": "43e12ab9-8b98-4af6-b15a-f9f8a29deb09"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:38.046351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-13047d45-215b-4119-b313-8980d097d22a req-c1baff38-c55b-4873-8d9f-d59df4341c7c service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:38.046796 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-13047d45-215b-4119-b313-8980d097d22a req-c1baff38-c55b-4873-8d9f-d59df4341c7c service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:38.071981 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-13047d45-215b-4119-b313-8980d097d22a req-c1baff38-c55b-4873-8d9f-d59df4341c7c service nova] Creating event network-vif-deleted:43e12ab9-8b98-4af6-b15a-f9f8a29deb09 for instance c78b6a91-9299-4181-925f-3967e7df03e5 on hv-cinder-79760 Jul 12 16:26:38.078134 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-13047d45-215b-4119-b313-8980d097d22a req-c1baff38-c55b-4873-8d9f-d59df4341c7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051434 Jul 12 16:26:38.079968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 336/660] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:38.350259 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:38.351699 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:38.358953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:38.359401 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:38.360170 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:38.360604 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:38.395544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:38.396223 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:38.396678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lazy-loading 'fault' on Instance uuid c78b6a91-9299-4181-925f-3967e7df03e5 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:26:38.453320 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:38.462358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8ac0b016-476c-4e04-a2b7-a27337187bb1 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 200 len: 1331 microversion: 2.1 time: 0.115898 Jul 12 16:26:38.463157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 325/661] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:38 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:39.480379 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:39.481090 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:39.493946 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:39.495900 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:39.501140 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:39.505327 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:39.541698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 HTTP/1.1 Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:26:39.543736 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:26:39.545126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'c78b6a91-9299-4181-925f-3967e7df03e5'} Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:26:39.545864 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:26:39.547019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:26:39.549457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:26:39.551776 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6887f111-4add-4caf-afb9-6757468ccafa tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 404 len: 111 microversion: 2.1 time: 0.075867 Jul 12 16:26:39.552949 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 337/662] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:39 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:26:39.561032 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c5c93634-ba5c-40e4-b7a6-9dce0ab058e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '.version_select at 0x7f1da6321f70>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:39.596488 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c5c93634-ba5c-40e4-b7a6-9dce0ab058e8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494195506" status: 202 len: 0 microversion: 2.1 time: 0.038976 Jul 12 16:26:39.601559 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 326/663] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 16:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494195506 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:26:40.586354 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8a127d7d-2b7f-4d75-a8b3-0799c2232223 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: .version_select at 0x7f1da598c040>, body: {"keypair": {"name": "tempest-keypair-1466280650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz9Eg1VkHANBg/ih5HdyzPhibORAiwyrqZrG+PeFF/f8s8EAxKqiD6dtEdnePmeujt/hexlmcPyD+NOcbiY5S1oQ3meqlaOupdosOzoI8BllVc77nh2YA9Foe8B/EhKMA=="}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:40.608628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-8a127d7d-2b7f-4d75-a8b3-0799c2232223 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:26:40.613249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-8a127d7d-2b7f-4d75-a8b3-0799c2232223 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:26:40.649672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8a127d7d-2b7f-4d75-a8b3-0799c2232223 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068058 Jul 12 16:26:40.651192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 338/664] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:26:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:42.656538 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2042294943", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39"}], "security_groups": [{"name": "tempest-securitygroup--1974832238"}], "key_name": "tempest-keypair-1466280650", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:43.033908 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] validate_networks() for [('791ee5e9-1dde-4f5d-9828-6f2c1b9fdf39', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:26:43.510054 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:26:43.510505 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:26:43.511182 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:26:43.511597 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:26:43.512007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:26:43.521659 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:43.522242 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:43.523123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:43.523648 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:43.543440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:26:43.547436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Getting quotas for user ff8fa75fd97a4c7dacc1ab46b14b8b76 and project d5ae94369af249a9a7d80185508089d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:26:43.560101 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:26:43.563166 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:26:43.616346 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5dcb667a-8d31-4bae-8d18-c3571e5371f6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.964871 Jul 12 16:26:43.617012 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 327/665] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:26:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:26:43.628271 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-bf4a7757-18e5-472c-9c76-d0ce4292746f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:43.630136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-bf4a7757-18e5-472c-9c76-d0ce4292746f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:43.949759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-bf4a7757-18e5-472c-9c76-d0ce4292746f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:43.964104 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-bf4a7757-18e5-472c-9c76-d0ce4292746f tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1242 microversion: 2.1 time: 0.341043 Jul 12 16:26:43.964993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 339/666] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:43 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1242 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:26:44.981315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:44.983074 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:45.000394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:45.000900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:45.001741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:45.002188 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:45.150428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:45.159605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2563e7fb-8e8d-4c20-aef2-360bb88f137b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1312 microversion: 2.1 time: 0.182145 Jul 12 16:26:45.170638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 328/667] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:44 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:46.182158 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:46.183815 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:46.197524 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:46.198509 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:46.199470 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:46.201615 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:46.439298 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:46.451774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9a6d8258-98ec-4c55-a48b-9bb7e80e5d9d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.276644 Jul 12 16:26:46.453144 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 340/668] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:46 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:46.982660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-61eef9e8-bfc2-4ec0-8e59-9f589005cf72 req-affd2682-f058-45f9-8549-122681c2efc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a0659c-673b-42a0-a8e1-9caabb136980", "tag": "d61440e9-3af1-4cd0-9fc6-79183663f5a1"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:47.000351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-61eef9e8-bfc2-4ec0-8e59-9f589005cf72 req-affd2682-f058-45f9-8549-122681c2efc9 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:47.000802 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-61eef9e8-bfc2-4ec0-8e59-9f589005cf72 req-affd2682-f058-45f9-8549-122681c2efc9 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:47.025680 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-61eef9e8-bfc2-4ec0-8e59-9f589005cf72 req-affd2682-f058-45f9-8549-122681c2efc9 service nova] Creating event network-changed:d61440e9-3af1-4cd0-9fc6-79183663f5a1 for instance b4a0659c-673b-42a0-a8e1-9caabb136980 on hv-cinder-79760 Jul 12 16:26:47.031136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-61eef9e8-bfc2-4ec0-8e59-9f589005cf72 req-affd2682-f058-45f9-8549-122681c2efc9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052426 Jul 12 16:26:47.032593 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 329/669] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:47.468551 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:47.469486 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:47.483666 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:47.484124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:47.484897 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:47.485350 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:47.643812 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:47.652936 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-47c32882-dff8-4ad8-9885-86b59949e2e7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.188099 Jul 12 16:26:47.654356 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 341/670] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:47 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:48.671177 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:48.671881 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:48.680686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:48.681000 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:48.681830 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:48.682761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:48.875521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:48.880062 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:48.884860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0768d772-bc31-4116-ae72-377742d5e4e9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.218281 Jul 12 16:26:48.885605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 330/671] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:48 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:49.902299 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:49.903622 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:49.912629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:49.913411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:49.914414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:49.914911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:50.066583 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:50.074410 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-50843d49-779f-4b16-bf2e-8d6c12d91ef2 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.175927 Jul 12 16:26:50.076023 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 342/672] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:49 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:51.091848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:51.093076 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:51.100423 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:51.101078 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:51.103930 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:51.104615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:51.271924 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:51.279990 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5c76adda-3114-439e-9c4a-6ce3ca480cbe tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.192004 Jul 12 16:26:51.290066 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 331/673] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:51 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:52.297214 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:52.297855 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:52.304375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:52.305042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:52.306061 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:52.306700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:52.453159 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:52.462298 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-92f9b263-71bb-4a4e-900f-f48aa0a1a6c3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.168869 Jul 12 16:26:52.463442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 343/674] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:52 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:52.830940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-2171de0d-bceb-49e0-b695-6dad090b2cc3 req-47e9d422-ebf8-4fe4-ace1-bb1b3865573a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a0659c-673b-42a0-a8e1-9caabb136980", "name": "network-vif-plugged", "status": "completed", "tag": "d61440e9-3af1-4cd0-9fc6-79183663f5a1"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:52.843236 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:52.846338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-2171de0d-bceb-49e0-b695-6dad090b2cc3 req-47e9d422-ebf8-4fe4-ace1-bb1b3865573a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:52.847501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-2171de0d-bceb-49e0-b695-6dad090b2cc3 req-47e9d422-ebf8-4fe4-ace1-bb1b3865573a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:52.864077 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-2171de0d-bceb-49e0-b695-6dad090b2cc3 req-47e9d422-ebf8-4fe4-ace1-bb1b3865573a service nova] Creating event network-vif-plugged:d61440e9-3af1-4cd0-9fc6-79183663f5a1 for instance b4a0659c-673b-42a0-a8e1-9caabb136980 on hv-cinder-79760 Jul 12 16:26:52.870500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-2171de0d-bceb-49e0-b695-6dad090b2cc3 req-47e9d422-ebf8-4fe4-ace1-bb1b3865573a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044062 Jul 12 16:26:52.871322 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 332/675] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:26:53.480226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:53.480819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:53.487923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:53.488351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:53.489124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:53.489722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:53.642167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:53.650318 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-57b9a0e3-87f3-4dcf-891b-5fd9928f1cb8 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.174084 Jul 12 16:26:53.651415 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 344/676] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:53 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:54.565297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:54.566643 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:54.571689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-87832c44-6370-4b49-89dd-77ed4597d42a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Action: 'create', calling method: .version_select at 0x7f1da59570d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-814321037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlKitg17AIRBkPqCOk8BxLyOeZI3/6AOCPWBlZmhNjQKRTOpoRs9bnsm9cNeXBQzWybgEi8e8s88PRHUNixoh4KRHe0AJfL9YtAYDsh+D6Te3aB9FgCdR7EeKVfLCMr0w=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:54.587010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-87832c44-6370-4b49-89dd-77ed4597d42a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Getting quotas for project 33d90fe735cb45cc9040fe625e3da849. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:26:54.590850 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-87832c44-6370-4b49-89dd-77ed4597d42a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Getting quotas for user 92c807f4f54b44839af98759312bd2bf and project 33d90fe735cb45cc9040fe625e3da849. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:26:54.611291 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-87832c44-6370-4b49-89dd-77ed4597d42a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046920 Jul 12 16:26:54.611872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 333/677] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:26:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:54.667851 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:54.668675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:54.670812 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=6 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:54.677157 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:54.677602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:54.678391 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:54.678918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:54.682967 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:54.717711 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1316570205", "imageRef": "30344468-23c1-48d8-b0bd-208947ed68f1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-814321037", "networks": [{"uuid": "ee18004f-80ad-430d-a90d-b9c662e97411"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:54.768082 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] validate_networks() for [('ee18004f-80ad-430d-a90d-b9c662e97411', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:26:54.814126 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:54.824365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-61701d5b-3c0e-46f7-829f-11dc3d21dda3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1368 microversion: 2.1 time: 0.160603 Jul 12 16:26:54.825042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 345/678] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:54 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:55.135575 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:26:55.136030 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:26:55.136508 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:26:55.136969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:26:55.137402 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:26:55.146646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:55.147169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:55.147897 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:55.148328 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:55.165077 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Getting quotas for project 33d90fe735cb45cc9040fe625e3da849. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:26:55.168948 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Getting quotas for user 92c807f4f54b44839af98759312bd2bf and project 33d90fe735cb45cc9040fe625e3da849. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:26:55.179710 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:26:55.181983 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30344468-23c1-48d8-b0bd-208947ed68f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:26:55.226525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5ca1465e-7df0-40aa-8533-89490632c606 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512735 Jul 12 16:26:55.227161 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 334/679] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:26:55.237212 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4fe20ec4-ae1c-4fec-9a96-a106c91531c7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:55.237886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4fe20ec4-ae1c-4fec-9a96-a106c91531c7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:55.293116 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4fe20ec4-ae1c-4fec-9a96-a106c91531c7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:55.299769 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4fe20ec4-ae1c-4fec-9a96-a106c91531c7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1258 microversion: 2.1 time: 0.066679 Jul 12 16:26:55.300375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 346/680] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:55 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:55.841529 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:55.842167 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:55.849159 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:55.849600 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:55.850373 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:55.850794 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:55.979217 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:55.986844 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bd0b7f78-e05b-403e-8627-a3e43f032669 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1559 microversion: 2.1 time: 0.149942 Jul 12 16:26:55.987408 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 335/681] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:55 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:56.003346 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b4e2a0f3-7eb2-4ac0-bc84-dfdfa4669f15 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:56.004434 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b4e2a0f3-7eb2-4ac0-bc84-dfdfa4669f15 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:56.011424 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4e2a0f3-7eb2-4ac0-bc84-dfdfa4669f15 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:56.011866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4e2a0f3-7eb2-4ac0-bc84-dfdfa4669f15 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:56.012616 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4e2a0f3-7eb2-4ac0-bc84-dfdfa4669f15 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:56.013057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b4e2a0f3-7eb2-4ac0-bc84-dfdfa4669f15 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:56.087558 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b4e2a0f3-7eb2-4ac0-bc84-dfdfa4669f15 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087996 Jul 12 16:26:56.088177 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 347/682] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:26:55 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:26:56.316178 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:56.317273 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:56.331959 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:56.332450 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:56.333425 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:56.333865 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:56.402927 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:56.417924 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4a779c61-649f-4f41-bf58-26d16f2c8e56 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1316 microversion: 2.1 time: 0.105784 Jul 12 16:26:56.418521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 336/683] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:56 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:57.311317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-594a9b79-c2cd-4afa-a001-c13ab87d612f req-c9e89812-97bf-4863-aa6b-93ba5ae4c396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a0659c-673b-42a0-a8e1-9caabb136980", "tag": "d61440e9-3af1-4cd0-9fc6-79183663f5a1"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:26:57.331152 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-594a9b79-c2cd-4afa-a001-c13ab87d612f req-c9e89812-97bf-4863-aa6b-93ba5ae4c396 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:57.332123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-594a9b79-c2cd-4afa-a001-c13ab87d612f req-c9e89812-97bf-4863-aa6b-93ba5ae4c396 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:57.354586 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-594a9b79-c2cd-4afa-a001-c13ab87d612f req-c9e89812-97bf-4863-aa6b-93ba5ae4c396 service nova] Creating event network-changed:d61440e9-3af1-4cd0-9fc6-79183663f5a1 for instance b4a0659c-673b-42a0-a8e1-9caabb136980 on hv-cinder-79760 Jul 12 16:26:57.359924 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-594a9b79-c2cd-4afa-a001-c13ab87d612f req-c9e89812-97bf-4863-aa6b-93ba5ae4c396 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057761 Jul 12 16:26:57.361337 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 348/684] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:26:57.435554 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:57.437709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:57.447099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:57.447545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:57.448465 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:57.448904 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:57.635035 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:57.643308 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e5bd8fbb-c128-41eb-964d-60f4d6bec058 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.211505 Jul 12 16:26:57.645073 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 337/685] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:57 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:58.661479 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:58.662249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:58.670679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:58.671446 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:58.672523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:58.673443 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:58.806885 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:58.814318 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-39ed9f84-8c2f-447d-808e-d988d9a49e6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.158206 Jul 12 16:26:58.822297 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 349/686] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:58 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:26:59.834221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:26:59.834837 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:26:59.841529 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:59.841976 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:59.842934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:26:59.843631 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:26:59.989910 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:26:59.998668 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d3a0aa6d-67c0-41e7-b60b-403e54ebb41f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.168622 Jul 12 16:26:59.999392 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 338/687] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:26:59 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:00.915662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:00.916405 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:00.918771 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:00.924359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:00.924808 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:00.926395 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:00.926830 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:00.953835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:27:01.017184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:01.017962 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:01.031923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:01.031923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:01.031923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:01.031923 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:01.063376 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-dc0c7bee-8336-4b9e-aa2d-0fccb87a2179 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 204 len: 0 microversion: 2.1 time: 0.151682 Jul 12 16:27:01.071298 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 350/688] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:27:00 2022] DELETE /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:27:01.074738 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:01.075512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:01.081722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:01.082255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:01.083090 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:01.083595 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:01.196457 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:01.207698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-793e05b3-3977-4131-9fb2-898625027dc0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.194144 Jul 12 16:27:01.209425 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 339/689] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:01 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:01.245774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:01.254229 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-133607b1-4915-489c-98f7-2fe2956c64a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1577 microversion: 2.1 time: 0.183928 Jul 12 16:27:01.254822 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 351/690] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:01 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:02.226082 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:02.226683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:02.233492 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:02.233948 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:02.234728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:02.235169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:02.272695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:02.273364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:02.280989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:02.281600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:02.282517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:02.282948 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:02.400330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:02.415896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-caba05fa-b69f-48b3-b4d3-90b9cebe9e00 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.194028 Jul 12 16:27:02.416977 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 340/691] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:02 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:02.676278 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:02.684059 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-95b3adb9-1ed4-45f2-b3da-e8cda30c156d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1577 microversion: 2.1 time: 0.415786 Jul 12 16:27:02.684826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 352/692] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:02 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1577 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:02.869739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3f7c3f96-6667-456b-95a6-1e59ad9d9e86 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:02.870235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3f7c3f96-6667-456b-95a6-1e59ad9d9e86 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:02.876294 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f7c3f96-6667-456b-95a6-1e59ad9d9e86 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:02.876685 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f7c3f96-6667-456b-95a6-1e59ad9d9e86 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:02.877546 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f7c3f96-6667-456b-95a6-1e59ad9d9e86 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:02.877984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f7c3f96-6667-456b-95a6-1e59ad9d9e86 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:02.902047 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3f7c3f96-6667-456b-95a6-1e59ad9d9e86 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/ips" status: 200 len: 150 microversion: 2.20 time: 0.149723 Jul 12 16:27:02.902847 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 341/693] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jul 12 16:27:02 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/ips => generated 150 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 16:27:03.434228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:03.434837 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:03.441463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:03.441993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:03.442774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:03.443300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:03.661552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:03.670794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c8a3e5c7-e870-4be6-b9ab-a157b3ea2432 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.240535 Jul 12 16:27:03.671378 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 353/694] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:03 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:03.702400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:03.702991 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:03.710285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:03.710739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:03.711510 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:03.711940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:03.852565 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:03.860926 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cde96e3a-1eb2-4d2c-9a8d-eba613038812 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1577 microversion: 2.1 time: 0.162208 Jul 12 16:27:03.870070 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 342/695] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:03 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:04.687660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:04.688296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:04.694770 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:04.695219 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:04.695976 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:04.696411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:04.838480 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:04.849326 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b5574779-51de-43c7-bf1e-562883a1af6f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.165370 Jul 12 16:27:04.858836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 354/696] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:04 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:04.878653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:04.879253 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:04.885995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:04.886452 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:04.887226 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:04.887694 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:05.026045 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:05.034008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-34132be8-5437-4e8f-bddc-e900364baea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1577 microversion: 2.1 time: 0.159253 Jul 12 16:27:05.035366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 343/697] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:04 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:05.435238 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:05.435765 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:05.437761 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:05.443522 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:05.443965 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:05.444719 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:05.445179 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:05.468984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lazy-loading 'flavor' on Instance uuid 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:27:05.723580 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ce86d9fb-fc6d-419e-a759-9c9620c74b0c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/action" status: 202 len: 0 microversion: 2.20 time: 0.291862 Jul 12 16:27:05.724193 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 355/698] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 16:27:05 2022] POST /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 16:27:05.732320 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:05.732930 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:05.734756 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:05.735733 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=10 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:05.741699 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:05.742124 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:05.742880 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:05.743313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:05.867254 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:05.867943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:05.874390 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:05.874838 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:05.875624 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:05.876061 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:05.954460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:05.963208 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:05.964716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:05.965913 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1b642e30-6aeb-4f5d-8341-edeae4395239 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.237487 Jul 12 16:27:05.966473 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 344/699] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:05 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:06.011076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:06.018603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7500b585-7d1a-4d1f-b87b-6a61980cd886 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.155652 Jul 12 16:27:06.020033 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 356/700] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:05 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:06.051651 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:06.052268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:06.058210 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:06.058665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:06.059436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:06.059875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:06.246738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:06.254388 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-053bf58c-c6c1-413c-8fb3-f745cd59a003 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1577 microversion: 2.1 time: 0.207282 Jul 12 16:27:06.254955 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 345/701] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:06 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:06.548118 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-ea3bcaca-71d0-40f8-986a-ccd2983c26d5 req-18e031d8-3035-4241-ae2d-6dc04cd4281b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5517e0ab-0a63-452e-95b1-53dea9fec2f7", "tag": "6f039bbe-a479-47f1-b01b-e2bdc0aa0973"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:06.558079 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-ea3bcaca-71d0-40f8-986a-ccd2983c26d5 req-18e031d8-3035-4241-ae2d-6dc04cd4281b service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:06.558535 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-ea3bcaca-71d0-40f8-986a-ccd2983c26d5 req-18e031d8-3035-4241-ae2d-6dc04cd4281b service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:06.570538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-ea3bcaca-71d0-40f8-986a-ccd2983c26d5 req-18e031d8-3035-4241-ae2d-6dc04cd4281b service nova] Creating event network-changed:6f039bbe-a479-47f1-b01b-e2bdc0aa0973 for instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 on hv-cinder-79760 Jul 12 16:27:06.575574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-ea3bcaca-71d0-40f8-986a-ccd2983c26d5 req-18e031d8-3035-4241-ae2d-6dc04cd4281b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032447 Jul 12 16:27:06.576178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 357/702] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:06.983893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:06.984444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:06.991823 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:06.992279 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:06.993041 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:06.993554 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:07.036689 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:07.037443 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:07.045922 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:07.046598 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:07.047405 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:07.047835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:07.139394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:07.148903 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:07.150397 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:07.152217 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a6e06c37-4718-42b8-bd51-0ead05b4c170 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.171930 Jul 12 16:27:07.164056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 346/703] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:06 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:07.194383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:07.201718 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8af119b1-6c66-439d-821f-aba02320773f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.169753 Jul 12 16:27:07.202276 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 358/704] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:07 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:07.271579 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:07.272108 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:07.278057 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:07.278527 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:07.279285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:07.279716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:07.516330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:07.523750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bd6afefc-8a43-4d6d-98e9-51d8107e433b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1577 microversion: 2.1 time: 0.256050 Jul 12 16:27:07.524255 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 347/705] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:07 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:08.171170 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:08.172071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:08.179893 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:08.180484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:08.181387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:08.181971 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:08.218848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:08.220185 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:08.230036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:08.230569 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:08.231428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:08.232148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:08.405192 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:08.415347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:08.417262 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:08.418617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ee716682-167d-4e5c-9c84-21d4a2d22858 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.251524 Jul 12 16:27:08.420140 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 359/706] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:08 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:08.543492 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:08.544106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:08.552287 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:08.552759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:08.553590 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:08.554240 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:08.611723 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:08.619172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-08378246-1ae1-4caf-ada7-187e806845ab tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.404293 Jul 12 16:27:08.619747 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 348/707] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:08 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:08.630343 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:08.634404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:08.639418 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cacb7266-b668-4e7b-9996-af658de6d34a tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1509 microversion: 2.1 time: 0.100435 Jul 12 16:27:08.639993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 360/708] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:08 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1509 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:08.700958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-53f37f78-c942-40e3-9211-97aa581d3a50 req-4e1e4106-e42c-4e10-9ae5-cb6fcf29bb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a46c12-84ab-439b-8713-9f1c53c96387", "name": "network-vif-deleted", "tag": "d87184f1-4c6a-40cd-8e42-e46af9d4a593"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:08.714338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-53f37f78-c942-40e3-9211-97aa581d3a50 req-4e1e4106-e42c-4e10-9ae5-cb6fcf29bb30 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:08.716410 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-53f37f78-c942-40e3-9211-97aa581d3a50 req-4e1e4106-e42c-4e10-9ae5-cb6fcf29bb30 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:08.740636 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-53f37f78-c942-40e3-9211-97aa581d3a50 req-4e1e4106-e42c-4e10-9ae5-cb6fcf29bb30 service nova] Creating event network-vif-deleted:d87184f1-4c6a-40cd-8e42-e46af9d4a593 for instance e7a46c12-84ab-439b-8713-9f1c53c96387 on hv-cinder-79760 Jul 12 16:27:08.745900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-53f37f78-c942-40e3-9211-97aa581d3a50 req-4e1e4106-e42c-4e10-9ae5-cb6fcf29bb30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048452 Jul 12 16:27:08.746633 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 349/709] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:09.438770 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:09.439390 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:09.448159 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:09.448937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:09.450341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:09.451150 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:09.584902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:09.592889 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:09.594400 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:09.595579 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-58f26480-6af6-4e69-aaf5-b27171733296 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.161108 Jul 12 16:27:09.596133 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 361/710] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:09 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:09.638257 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:09.638966 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:09.645969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:09.646428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:09.647204 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:09.647643 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:09.657080 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:09.658214 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:09.664841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:09.665336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:09.666171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:09.666612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:09.727883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:09.735802 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1f4dc591-8fbc-447f-8bc1-5ccb7931425f tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 200 len: 1225 microversion: 2.1 time: 0.082432 Jul 12 16:27:09.736557 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 362/711] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:09 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:09.783900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:09.787437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:09.792124 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-00d517eb-3d3f-41df-84af-a93bf1fec32d tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.160228 Jul 12 16:27:09.792681 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 350/712] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:09 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:10.614700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:10.615248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:10.621640 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:10.622070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:10.622824 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:10.623258 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:10.752783 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:10.753851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:10.754466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:10.761115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:10.761569 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:10.762206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:10.762344 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:10.762754 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:10.763729 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:10.764897 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b3143f03-8dcb-49a7-b07a-0e8a2791531c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.155074 Jul 12 16:27:10.765671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 363/713] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:10 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:10.777722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] HTTP exception thrown: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Request method failure captured: Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 HTTP/1.1 Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaAFkdQsoz9z1MtMsf9cN9wI-tx3TOxxdb9W998AyoH536ts8fSP_kApFHBIshMfgdBsAR-wb-J2KdVd5HHQQL3ooe579AkJMoSGvt-9HCUOkrC6vkZWRPkNQGsCymoG_MA_VkoXEzSMksbdiInw_J5Ds03OY2apEzvdYzvlrv9_Ox4 Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:27:10.779378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dca15cc5b53b4c51a9f7a6ce0f827ebd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: a69aa7a2c98d4f30a5585c89e5295eb7 Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:27:10.780838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'e7a46c12-84ab-439b-8713-9f1c53c96387'} Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:27:10.782353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:27:10.783618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:27:10.784764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Returning 404 to user: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:27:10.784764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c593fd4b-ae6e-4843-aede-8742a1ec2ebc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 404 len: 111 microversion: 2.1 time: 0.032574 Jul 12 16:27:10.784764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 351/714] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:10 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:27:10.807861 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:10.808878 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:10.814943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:10.815394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:10.817023 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:10.817493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:10.890133 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-713641702", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1223961137", "security_groups": [{"name": "tempest-secgroup-smoke-2089313887"}], "block_device_mapping_v2": [{"uuid": "06c9bf2c-c07c-40c3-a572-0eee128bca3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e6199c1-7cb0-42ae-9742-827022684fbe"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:10.957513 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:10.967402 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c5b2f245-3054-479d-a993-5de4e55e270c tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.163391 Jul 12 16:27:10.967975 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 364/715] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:10 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:11.015995 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] validate_networks() for [('0e6199c1-7cb0-42ae-9742-827022684fbe', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:27:11.210874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:11.211448 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:11.217874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.218355 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.219135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.219577 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.310562 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lazy-loading 'services' on Instance uuid c565037f-2db4-4746-b8ff-c1e0fbe431df {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:27:11.390841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a02a2532-da16-4330-8e72-3d41cbeac23a tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments/847a025c-81f1-4e7b-97c6-090f2f33933c" status: 202 len: 0 microversion: 2.1 time: 0.183984 Jul 12 16:27:11.391282 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 365/716] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:27:11 2022] DELETE /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments/847a025c-81f1-4e7b-97c6-090f2f33933c => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 16:27:11.400274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5e6ba3c5-e031-4a20-a924-123c62ae32e1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:11.401359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5e6ba3c5-e031-4a20-a924-123c62ae32e1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:11.407600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5e6ba3c5-e031-4a20-a924-123c62ae32e1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.408071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5e6ba3c5-e031-4a20-a924-123c62ae32e1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.408909 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5e6ba3c5-e031-4a20-a924-123c62ae32e1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.409363 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5e6ba3c5-e031-4a20-a924-123c62ae32e1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.439421 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5e6ba3c5-e031-4a20-a924-123c62ae32e1 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 Jul 12 16:27:11.441638 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 366/717] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:27:11 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:11.462171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:27:11.462599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:27:11.463078 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:27:11.463496 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:27:11.463912 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:27:11.472679 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.473160 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.473968 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.474710 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.491780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:27:11.496005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for user a69aa7a2c98d4f30a5585c89e5295eb7 and project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:27:11.553881 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:27:11.555931 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06c9bf2c-c07c-40c3-a572-0eee128bca3b',volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:27:11.680989 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0a9c531d-bbc1-4dc1-859f-188fdbb47f1b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794630 Jul 12 16:27:11.681670 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 352/718] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:27:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 16:27:11.692215 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-65527ac9-e9f1-47d1-81cb-b8126c235040 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:11.692914 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-65527ac9-e9f1-47d1-81cb-b8126c235040 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:11.746918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-65527ac9-e9f1-47d1-81cb-b8126c235040 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:11.754381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-65527ac9-e9f1-47d1-81cb-b8126c235040 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1094 microversion: 2.1 time: 0.066083 Jul 12 16:27:11.755033 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 367/719] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:11 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:11.784142 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:11.784782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:11.791389 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.791835 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.792598 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.793034 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.923779 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:11.932419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:11.933947 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:11.935123 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dd37dc0b-6836-454a-aabb-43426cf23843 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.155405 Jul 12 16:27:11.935663 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 353/720] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:11 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:11.987033 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:11.989279 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:11.997515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.997974 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:11.998746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:11.999187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.132530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:12.143574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5c721622-22dc-438f-b9a9-d59356fdfef9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.162882 Jul 12 16:27:12.144409 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 368/721] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:11 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:12.450830 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7e6a57f9-4107-468f-8f08-b676d65f00c4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:12.451802 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7e6a57f9-4107-468f-8f08-b676d65f00c4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:12.458269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e6a57f9-4107-468f-8f08-b676d65f00c4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.458713 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e6a57f9-4107-468f-8f08-b676d65f00c4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.459465 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e6a57f9-4107-468f-8f08-b676d65f00c4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.459898 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e6a57f9-4107-468f-8f08-b676d65f00c4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.488639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7e6a57f9-4107-468f-8f08-b676d65f00c4 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041770 Jul 12 16:27:12.489200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 354/722] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:27:12 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:27:12.560340 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:12.560868 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:12.566852 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.567308 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.568094 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.568534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.592700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:27:12.665474 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6090b142-ffe7-499f-9ec9-023c8d7c367e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 204 len: 0 microversion: 2.1 time: 0.108560 Jul 12 16:27:12.666198 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 369/723] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:27:12 2022] DELETE /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:27:12.673964 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:12.674569 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:12.681479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.681928 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.683303 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.683747 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.773099 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:12.774546 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:12.781352 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.781810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.782648 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.783153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.836079 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:12.844891 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-142dd2a7-62c0-45ac-9055-6e6d3709ebcd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1687 microversion: 2.1 time: 0.174492 Jul 12 16:27:12.845767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 355/724] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:12 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:12.847433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:12.856137 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3055ad6c-1bee-443a-86a7-fa067ebb59dc tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1200 microversion: 2.1 time: 0.087836 Jul 12 16:27:12.856706 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 370/725] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:12 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1200 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:12.900345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-9bc174ef-b44b-4018-81f9-1129ea761428 req-4b59cdb3-c461-4946-bc01-2894f098ade0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5517e0ab-0a63-452e-95b1-53dea9fec2f7", "name": "network-vif-plugged", "status": "completed", "tag": "6f039bbe-a479-47f1-b01b-e2bdc0aa0973"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:12.908307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-9bc174ef-b44b-4018-81f9-1129ea761428 req-4b59cdb3-c461-4946-bc01-2894f098ade0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.908869 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-9bc174ef-b44b-4018-81f9-1129ea761428 req-4b59cdb3-c461-4946-bc01-2894f098ade0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.922000 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-9bc174ef-b44b-4018-81f9-1129ea761428 req-4b59cdb3-c461-4946-bc01-2894f098ade0 service nova] Creating event network-vif-plugged:6f039bbe-a479-47f1-b01b-e2bdc0aa0973 for instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 on hv-cinder-79760 Jul 12 16:27:12.926787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-9bc174ef-b44b-4018-81f9-1129ea761428 req-4b59cdb3-c461-4946-bc01-2894f098ade0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030066 Jul 12 16:27:12.927550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 356/726] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:12.953201 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:12.953812 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:12.960292 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.960747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:12.961558 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:12.961985 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:13.087303 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:13.095133 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:13.096714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:13.098492 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e397c0f2-02c1-4550-a453-14db8007e5b3 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.149282 Jul 12 16:27:13.099044 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 371/727] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:12 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:13.161335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:13.162027 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:13.168109 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:13.168551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:13.169333 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:13.169766 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:13.293865 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:13.301044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-00bc8b24-7820-46bf-857d-e80252620e91 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.144769 Jul 12 16:27:13.301617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 357/728] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:13 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:13.862102 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:13.863203 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:13.869323 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:13.869769 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:13.870523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:13.870955 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:13.873156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:13.873760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:13.880115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:13.880555 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:13.881327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:13.881762 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:13.943823 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:13.951525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-26e6b713-643f-41f4-9bfb-9529663f2214 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1200 microversion: 2.1 time: 0.082210 Jul 12 16:27:13.952391 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 358/729] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:13 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:14.002272 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:14.009791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-736327dc-3f61-473e-a26a-a046a85953d8 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1687 microversion: 2.1 time: 0.151762 Jul 12 16:27:14.010360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 372/730] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:13 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:14.116741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:14.117338 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:14.123251 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:14.123701 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:14.124462 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:14.124899 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:14.253025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:14.262110 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:14.263786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:14.265278 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9598f174-50da-4c33-ab2f-fee7ca4f4706 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.152412 Jul 12 16:27:14.266281 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 359/731] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:14 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:14.317977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:14.318590 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:14.325102 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:14.325556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:14.326316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:14.326747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:14.449996 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:14.457783 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-67aa6cd2-1e6f-4691-99b1-a18a2ccc25a0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.144169 Jul 12 16:27:14.458341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 373/732] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:14 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:14.967653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:14.968265 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:14.974276 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:14.974727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:14.975481 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:14.975916 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:15.027118 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:15.027721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:15.034888 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:15.035342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:15.036111 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:15.036544 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:15.036934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:15.045425 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-38f13c6e-ca84-4e9e-9af2-f5e6f60ab994 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1200 microversion: 2.1 time: 0.081490 Jul 12 16:27:15.046223 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 360/733] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:14 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1200 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:15.166692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:15.174171 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3646ab77-d641-4ef7-94a9-0f5584befa35 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1687 microversion: 2.1 time: 0.151011 Jul 12 16:27:15.174728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 374/734] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:15 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:15.285370 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:15.285917 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:15.288297 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:15.293589 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:15.294041 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:15.294799 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:15.295234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:15.420766 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:15.429163 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:15.430681 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:15.432042 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b674ad20-ef7e-4d6f-9210-d05585faadac tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.150652 Jul 12 16:27:15.432607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 361/735] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:15 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:15.474067 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:15.474675 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:15.481132 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:15.481582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:15.482336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:15.482781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:15.613176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:15.620480 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-39b7be27-9ae3-43c3-814e-e3fa60ea800a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.150212 Jul 12 16:27:15.621038 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 375/736] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:15 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:16.062164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:16.062831 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:16.069504 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.069951 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.070705 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.071139 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.130994 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:16.138628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-96df60c6-c139-4d44-a76c-622c58e5fae9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1210 microversion: 2.1 time: 0.080265 Jul 12 16:27:16.139392 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 362/737] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:16 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:16.194006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:16.194698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:16.203218 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.203684 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.204549 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.205043 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.209677 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:16.430905 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:16.438382 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0badf56f-0902-48f9-93e0-a6d0e1ed8d96 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1687 microversion: 2.1 time: 0.251287 Jul 12 16:27:16.439036 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 376/738] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:16 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1687 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:16.452212 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:16.452866 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:16.459587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.460036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.460806 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.461278 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.637249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:16.637863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:16.644650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.645131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.645894 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:16.646333 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:16.796963 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:16.806885 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-83df5d94-c793-452d-8876-15c4571ef7ad tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1358 microversion: 2.1 time: 0.173555 Jul 12 16:27:16.807876 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 377/739] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:16 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:16.808011 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:16.821799 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:16.823451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:16.824761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-97741086-50c4-48d7-854a-ae751dc886ce tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.377842 Jul 12 16:27:16.825781 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 363/740] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:16 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:17.165964 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:17.167405 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:17.173527 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.174050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.174957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.175462 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.335079 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:17.351206 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0e0d6c9c-728d-4f4a-b190-4979a1bd94d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.189056 Jul 12 16:27:17.351798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 378/741] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:17 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:17.456339 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:17.457635 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:17.464328 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.464778 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.465576 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.466015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.564806 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:17.572567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-30153fbe-bfe0-4451-b80c-c3a5b7f50d4e tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1620 microversion: 2.1 time: 0.120115 Jul 12 16:27:17.579099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 364/742] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:17 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1620 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:17.824337 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:17.825665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:17.833760 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.834456 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.834950 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-bda41c32-17ec-40ce-b868-1081b5ae2bf7 req-61010b19-de56-48aa-93b2-9d41025b845e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c565037f-2db4-4746-b8ff-c1e0fbe431df", "name": "network-vif-deleted", "tag": "b10043d7-6d3e-46b6-b837-b811a5e4b22a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:17.835598 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.836195 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.849105 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-bda41c32-17ec-40ce-b868-1081b5ae2bf7 req-61010b19-de56-48aa-93b2-9d41025b845e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.850081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-bda41c32-17ec-40ce-b868-1081b5ae2bf7 req-61010b19-de56-48aa-93b2-9d41025b845e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.867087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-bda41c32-17ec-40ce-b868-1081b5ae2bf7 req-61010b19-de56-48aa-93b2-9d41025b845e service nova] Creating event network-vif-deleted:b10043d7-6d3e-46b6-b837-b811a5e4b22a for instance c565037f-2db4-4746-b8ff-c1e0fbe431df on hv-cinder-79760 Jul 12 16:27:17.873000 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-bda41c32-17ec-40ce-b868-1081b5ae2bf7 req-61010b19-de56-48aa-93b2-9d41025b845e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043671 Jul 12 16:27:17.874256 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 365/743] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:17.879943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:17.881383 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:17.888184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.888984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.890014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:17.890674 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:17.982119 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:17.990609 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ced4e5ed-02c4-44c6-a987-22481db1e9a9 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1549 microversion: 2.1 time: 0.170619 Jul 12 16:27:17.991177 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 379/744] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:17 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:18.012040 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:18.012755 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:18.022262 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.022810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.023656 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.024161 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.120828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.139170 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.142002 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.146079 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2cbac460-e548-4db5-9fed-ceceac7f9ccf tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1743 microversion: 2.20 time: 0.270437 Jul 12 16:27:18.148856 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 366/745] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:17 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:18.214065 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.225371 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7d712ed1-d60f-44a7-8914-3ce583eab881 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1549 microversion: 2.1 time: 0.220829 Jul 12 16:27:18.227604 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 380/746] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:18 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1549 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:18.246139 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:18.257039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.257909 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Searching by: {'deleted': False, 'project_id': '33d90fe735cb45cc9040fe625e3da849'} {{(pid=117792) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 16:27:18.272669 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.273437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.274442 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.275066 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.369109 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:18.369719 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:18.382344 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.multi_cell_list [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117792) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 16:27:18.384404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.384931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.385837 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.386344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.561015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-924a0187-03fe-4311-90e8-4b54185d9071 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.318597 Jul 12 16:27:18.564911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.565815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 367/747] 10.222.0.20 () {58 vars in 1124 bytes} [Tue Jul 12 16:27:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:18.575982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:18.576595 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:18.580674 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2f1e601b-c426-4d99-a94f-1d446ed012fd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.215343 Jul 12 16:27:18.582438 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 381/748] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:18 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:18.589824 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:18.590871 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:18.595403 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.595858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.596881 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.597999 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.602172 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.603124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.604359 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.604866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.673873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:18.674605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:18.675837 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lazy-loading 'fault' on Instance uuid c565037f-2db4-4746-b8ff-c1e0fbe431df {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:27:18.759264 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.767901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2d930646-198f-4a3e-835c-da9a77c5ce53 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 200 len: 1335 microversion: 2.1 time: 0.181748 Jul 12 16:27:18.778252 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 382/749] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:18 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 1335 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:18.873263 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:18.884873 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-39b3fee2-ef1b-4fbf-8e02-8b679c53e692 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1549 microversion: 2.1 time: 0.312677 Jul 12 16:27:18.885493 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 368/750] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:18 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1549 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:19.173162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:19.174564 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:19.189129 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:19.190524 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:19.193805 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:19.198394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:19.414147 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:19.424268 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:19.427119 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:19.428670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-94e7012b-e2e1-4b01-9e83-8184100e8e12 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1743 microversion: 2.20 time: 0.266383 Jul 12 16:27:19.429381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 383/751] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:19 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:19.598559 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:19.599117 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:19.605452 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:19.605899 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:19.606650 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:19.607081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:19.735895 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:19.739464 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:19.744384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b624531b-2558-4355-89e3-c86532e5d786 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.149702 Jul 12 16:27:19.744946 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 369/752] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:19 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:19.784890 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:19.785546 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: c565037f-2db4-4746-b8ff-c1e0fbe431df] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:19.791511 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:19.791953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:19.792699 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:19.793161 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:19.806418 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] HTTP exception thrown: Instance c565037f-2db4-4746-b8ff-c1e0fbe431df could not be found. Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Request method failure captured: Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df HTTP/1.1 Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-m9H521Lwot7C4VNMRpEa_HUy-NTX4_b9y9l4PuZqmXLZcsqAcUQ7bUOxpW-oJ1ajmPFEx6GutFRwqjlevwHRXxsSy4gOu7W-XULrDyEP1Pp9N6W7sXsyolvNC1rEUUf2Ck_xXjAgGHAR-EVynuAvnUFGyUaD0j3ZJVxbqHFT67xM Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:27:19.807997 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_641dd5eac4cf4352924c1610407bc5e3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: e980def45e934114a2f0bc7081ffe8e3 Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance c565037f-2db4-4746-b8ff-c1e0fbe431df could not be found. Jul 12 16:27:19.809649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'c565037f-2db4-4746-b8ff-c1e0fbe431df'} Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c565037f-2db4-4746-b8ff-c1e0fbe431df could not be found. Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:27:19.810717 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c565037f-2db4-4746-b8ff-c1e0fbe431df could not be found. Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c565037f-2db4-4746-b8ff-c1e0fbe431df could not be found. Jul 12 16:27:19.812143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:19.813603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Returning 404 to user: Instance c565037f-2db4-4746-b8ff-c1e0fbe431df could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:27:19.813603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b8d9371b-8bae-4f7f-9160-9cc08c4bf7ed tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df" status: 404 len: 111 microversion: 2.1 time: 0.028273 Jul 12 16:27:19.813603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 384/753] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:19 2022] GET /compute/v2.1/servers/c565037f-2db4-4746-b8ff-c1e0fbe431df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:27:19.818615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0261c649-9e1e-478f-b7de-53234de7b881 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '.version_select at 0x7f1da592cb80>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:19.835288 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0261c649-9e1e-478f-b7de-53234de7b881 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199178828" status: 202 len: 0 microversion: 2.1 time: 0.021273 Jul 12 16:27:19.835872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 370/754] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 16:27:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199178828 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 16:27:19.907027 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-8fde7608-3c59-4e0a-8f99-ad25e660de5a req-586eaf36-37a7-4a8f-99a0-32f54c41a2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3150f6-a658-4e6f-9692-d05e0d350072", "tag": "c8923a42-4682-40f9-9ae7-84a0f1a561d6"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:19.915147 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8fde7608-3c59-4e0a-8f99-ad25e660de5a req-586eaf36-37a7-4a8f-99a0-32f54c41a2bf service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:19.915531 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8fde7608-3c59-4e0a-8f99-ad25e660de5a req-586eaf36-37a7-4a8f-99a0-32f54c41a2bf service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:19.926782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-8fde7608-3c59-4e0a-8f99-ad25e660de5a req-586eaf36-37a7-4a8f-99a0-32f54c41a2bf service nova] Creating event network-changed:c8923a42-4682-40f9-9ae7-84a0f1a561d6 for instance ac3150f6-a658-4e6f-9692-d05e0d350072 on hv-cinder-79760 Jul 12 16:27:19.931740 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-8fde7608-3c59-4e0a-8f99-ad25e660de5a req-586eaf36-37a7-4a8f-99a0-32f54c41a2bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028313 Jul 12 16:27:19.932394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 385/755] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:20.447063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:20.447828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:20.454068 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:20.454588 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:20.455424 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:20.456097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:20.555377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7907f4bc-90f7-436d-a0fd-f91fd229e291 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15b8a1ca-1660-4af8-b5c1-3d3303dce4d9"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:20.556507 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7907f4bc-90f7-436d-a0fd-f91fd229e291 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:20.562714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7907f4bc-90f7-436d-a0fd-f91fd229e291 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:20.563162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7907f4bc-90f7-436d-a0fd-f91fd229e291 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:20.563927 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7907f4bc-90f7-436d-a0fd-f91fd229e291 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:20.564360 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7907f4bc-90f7-436d-a0fd-f91fd229e291 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:20.746791 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:20.756532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:20.758627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:20.760071 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-11eb9f97-56ef-4464-abb7-22e68d17fd16 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1743 microversion: 2.20 time: 0.317151 Jul 12 16:27:20.760850 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 371/756] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:20 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1743 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:20.774925 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:20.776863 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:20.783405 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:20.784138 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:20.785221 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:20.785879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:20.850825 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7907f4bc-90f7-436d-a0fd-f91fd229e291 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300737 Jul 12 16:27:20.851444 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 386/757] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:27:20 2022] POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:21.012287 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-8c076295-6de2-47c8-92cb-25cee0a2e2b8 req-9a14f561-8761-4181-aae6-87b8769815a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e", "name": "network-vif-plugged", "status": "completed", "tag": "77b11a6f-6e1f-4b01-ab67-32247582df08"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:21.029445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8c076295-6de2-47c8-92cb-25cee0a2e2b8 req-9a14f561-8761-4181-aae6-87b8769815a6 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:21.029985 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8c076295-6de2-47c8-92cb-25cee0a2e2b8 req-9a14f561-8761-4181-aae6-87b8769815a6 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:21.052559 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-8c076295-6de2-47c8-92cb-25cee0a2e2b8 req-9a14f561-8761-4181-aae6-87b8769815a6 service nova] Creating event network-vif-plugged:77b11a6f-6e1f-4b01-ab67-32247582df08 for instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e on hv-cinder-79760 Jul 12 16:27:21.056529 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:21.071560 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-8c076295-6de2-47c8-92cb-25cee0a2e2b8 req-9a14f561-8761-4181-aae6-87b8769815a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064752 Jul 12 16:27:21.073683 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 387/758] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:21.077488 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-080a7c0c-731e-4b21-977e-e0ff8f4775d6 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.315017 Jul 12 16:27:21.087437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 372/759] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:20 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:21.780541 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:21.781268 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:21.783643 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:21.791316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:21.792903 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:21.793919 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:21.794592 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:21.961891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:21.971589 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:21.973330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:21.974626 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e7cdb510-3ffa-46a0-b262-d6cf9c5c520a tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.198701 Jul 12 16:27:21.977787 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 388/760] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:21 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:22.095164 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:22.095930 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:22.098430 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:22.104071 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:22.104537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:22.105335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:22.105984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:22.283045 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:22.292668 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-39da7c90-7f00-473a-9f31-7235ccdc182b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.201235 Jul 12 16:27:22.301407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 373/761] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:22 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:22.994407 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:22.995771 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:23.006601 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.007679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.008622 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.009417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.169507 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:23.179113 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:23.180648 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:23.181836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-53b9e79a-f9b7-49c7-abe7-87cc4fd74a6b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.191806 Jul 12 16:27:23.182989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 389/762] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:22 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:23.310275 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:23.311569 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:23.327263 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.329866 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.333944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.334400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.354968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:23.355725 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:23.364309 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.364880 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.366553 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.367552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.402544 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:27:23.483728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:23.501009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-94d30e0c-5395-4b10-932c-89cdbf1ca98d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 204 len: 0 microversion: 2.1 time: 0.149722 Jul 12 16:27:23.502017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 390/763] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:27:23 2022] DELETE /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:27:23.506004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:23.514136 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:23.514381 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6a356b5b-79bf-449c-9d20-ebd18743adce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.208253 Jul 12 16:27:23.515006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:23.524951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.524951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.524951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:23.524951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:23.526055 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 374/764] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:23 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:23.547351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:23.674638 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:23.682984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-35f6850f-a915-4569-8dc8-d9a0919924dd tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1507 microversion: 2.1 time: 0.174331 Jul 12 16:27:23.683550 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 391/765] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:23 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:24.199626 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:24.200584 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:24.207820 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:24.208661 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:24.209868 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:24.211050 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:24.363413 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:24.371403 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:24.372899 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:24.374069 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0edce347-7471-440e-9e97-4742318b79df tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.178323 Jul 12 16:27:24.374835 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 375/766] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:24 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:24.532867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:24.534250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:24.541294 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:24.542087 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:24.543070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:24.543724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:24.688495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:24.697170 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d9e8b6d4-7eb4-4f02-917e-251aa3182185 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.168338 Jul 12 16:27:24.697749 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 392/767] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:24 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:24.699869 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:24.700486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:24.710693 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:24.711146 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:24.711955 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:24.712395 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:24.857893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:24.867324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3270a297-3786-4fb5-9787-7c968a04d4dc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1507 microversion: 2.1 time: 0.171422 Jul 12 16:27:24.870578 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 376/768] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:24 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:25.395316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:25.396574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:25.403374 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:25.410686 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:25.411599 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:25.412050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:25.562165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:25.571324 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:25.577530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:25.577530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d5a3e26a-c4ed-45f5-a7ba-1c954e099149 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.184474 Jul 12 16:27:25.577530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 393/769] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:25 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:25.714957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:25.716274 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:25.723614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:25.724434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:25.725359 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:25.725927 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:25.871413 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:25.883629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ee33e974-e253-42f3-819d-b45cb280ac1c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.172551 Jul 12 16:27:25.884647 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 377/770] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:25 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:25.893227 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:25.893227 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:25.898115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:25.898115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:25.899277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:25.899615 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:26.048178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:26.055917 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-42ab9723-9230-4825-9076-0baa4e0686b3 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1507 microversion: 2.1 time: 0.171731 Jul 12 16:27:26.056665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 394/771] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:25 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:26.591846 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:26.592117 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:26.599215 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:26.599660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:26.600421 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:26.600850 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:26.758067 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:26.767807 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:26.769617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:26.771236 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4f1be4ec-b690-436c-8426-3273a32b8155 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.183658 Jul 12 16:27:26.781766 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 378/772] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:26 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:26.900814 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:26.901478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:26.908086 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:26.911867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:26.911867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:26.911867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:27.072778 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:27.073455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:27.085037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:27.086059 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:27.087080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:27.087765 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:27.088987 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:27.103303 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8987fda0-6d11-40b4-8645-44cdf8048981 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.206247 Jul 12 16:27:27.114098 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 395/773] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:26 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:27.359137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:27.367743 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d87435f5-c06c-4301-8028-180fb42f1b57 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1507 microversion: 2.1 time: 0.298738 Jul 12 16:27:27.368540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 379/774] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:27 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:27.789412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:27.790140 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:27.804718 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:27.805276 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:27.805973 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:27.806411 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:27.848474 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-06dfbe4a-2d21-48c5-9f63-92474c4a047a req-788a84ba-a039-4635-9b52-edd232d6f6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b", "name": "network-vif-deleted", "tag": "bb8c098f-fbb4-46b3-abf2-a2248399930d"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:27.868957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-06dfbe4a-2d21-48c5-9f63-92474c4a047a req-788a84ba-a039-4635-9b52-edd232d6f6fb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:27.873286 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-06dfbe4a-2d21-48c5-9f63-92474c4a047a req-788a84ba-a039-4635-9b52-edd232d6f6fb service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:27.886422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-06dfbe4a-2d21-48c5-9f63-92474c4a047a req-788a84ba-a039-4635-9b52-edd232d6f6fb service nova] Creating event network-vif-deleted:bb8c098f-fbb4-46b3-abf2-a2248399930d for instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b on hv-cinder-79760 Jul 12 16:27:27.898494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-06dfbe4a-2d21-48c5-9f63-92474c4a047a req-788a84ba-a039-4635-9b52-edd232d6f6fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133992 Jul 12 16:27:27.899693 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 396/775] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:28.060883 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:28.072750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:28.075100 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:28.076465 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f1e4cfff-2c21-4b46-8d58-03d82aa46a3b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.291786 Jul 12 16:27:28.077586 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 380/776] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:27 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:28.121550 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:28.122965 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:28.131109 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:28.131595 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:28.132330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:28.132943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:28.298980 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:28.317777 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-69e57511-597a-4ac5-a710-94c96b154846 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.197704 Jul 12 16:27:28.319314 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 397/777] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:28 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:28.384526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:28.385475 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:28.390971 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:28.393127 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:28.394472 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:28.395678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:28.396362 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:28.450268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:28.450813 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:28.451532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lazy-loading 'fault' on Instance uuid f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:27:28.501678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:28.509857 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bc1b7e05-f9ab-4598-9f49-7b154ca9c908 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 200 len: 1312 microversion: 2.1 time: 0.129093 Jul 12 16:27:28.510729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 381/778] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:28 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:28.532338 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:28.533064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:28.543050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:28.543750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:28.544509 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:28.544944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:28.695893 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:28.704103 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-109883bd-5991-4604-beba-af274aa8902b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1595 microversion: 2.1 time: 0.176725 Jul 12 16:27:28.705013 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 398/779] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:28 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1595 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:29.042239 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-45c7677f-c48c-4681-8ec4-1ff68d6eddb4 req-15e224a1-3f01-4147-922d-983c639cabde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3150f6-a658-4e6f-9692-d05e0d350072", "name": "network-vif-plugged", "status": "completed", "tag": "c8923a42-4682-40f9-9ae7-84a0f1a561d6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:29.059378 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-45c7677f-c48c-4681-8ec4-1ff68d6eddb4 req-15e224a1-3f01-4147-922d-983c639cabde service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.060558 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-45c7677f-c48c-4681-8ec4-1ff68d6eddb4 req-15e224a1-3f01-4147-922d-983c639cabde service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.078105 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-45c7677f-c48c-4681-8ec4-1ff68d6eddb4 req-15e224a1-3f01-4147-922d-983c639cabde service nova] Creating event network-vif-plugged:c8923a42-4682-40f9-9ae7-84a0f1a561d6 for instance ac3150f6-a658-4e6f-9692-d05e0d350072 on hv-cinder-79760 Jul 12 16:27:29.084267 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-45c7677f-c48c-4681-8ec4-1ff68d6eddb4 req-15e224a1-3f01-4147-922d-983c639cabde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048241 Jul 12 16:27:29.088247 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 382/780] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:29.095320 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:29.095926 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:29.102441 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.103158 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.104101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.104695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.339060 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:29.340137 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:29.359045 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.360161 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.361206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.365709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.496798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:29.520806 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:29.528396 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:29.533804 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8e44a736-b3ad-4533-92c0-9a3186fcee14 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.438355 Jul 12 16:27:29.535854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 399/781] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:29 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:29.542818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:29.550811 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:29.553585 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-70befbe9-dab6-47ca-adf3-484e58be4f70 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.220766 Jul 12 16:27:29.554351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 383/782] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:29 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:29.564725 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:29.571117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.571845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.572840 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.573302 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.588917 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] HTTP exception thrown: Instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b could not be found. Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Request method failure captured: Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b HTTP/1.1 Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-m9H521Lwot7C4VNMRpEa_HUy-NTX4_b9y9l4PuZqmXLZcsqAcUQ7bUOxpW-oJ1ajmPFEx6GutFRwqjlevwHRXxsSy4gOu7W-XULrDyEP1Pp9N6W7sXsyolvNC1rEUUf2Ck_xXjAgGHAR-EVynuAvnUFGyUaD0j3ZJVxbqHFT67xM Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:27:29.590979 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_641dd5eac4cf4352924c1610407bc5e3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: e980def45e934114a2f0bc7081ffe8e3 Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b could not be found. Jul 12 16:27:29.592426 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b'} Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b could not be found. Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:27:29.593200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b could not be found. Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b could not be found. Jul 12 16:27:29.594989 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:29.598255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Returning 404 to user: Instance f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:27:29.598255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-39fa56a9-6eda-4d39-8bde-3906f7bbf8cc tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b" status: 404 len: 111 microversion: 2.1 time: 0.055351 Jul 12 16:27:29.598255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 400/783] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:29 2022] GET /compute/v2.1/servers/f2e0ca01-5c1b-4d9e-b7ed-4cbc4584150b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:27:29.603525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:29.604035 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:29.614645 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.615098 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.615900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.616347 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.653379 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:27:29.777157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ab8ab6d4-3127-4ccd-af07-bca4d8945cb0 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 204 len: 0 microversion: 2.1 time: 0.177666 Jul 12 16:27:29.777869 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 384/784] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:27:29 2022] DELETE /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 16:27:29.795475 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:29.796159 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:29.802484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.802815 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:29.803710 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:29.804236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:30.052993 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:30.066701 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-bee48648-09e0-4aab-a509-411b73da421d tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.275773 Jul 12 16:27:30.076444 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 401/785] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:29 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:30.554744 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:30.555525 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:30.562309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:30.562765 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:30.563545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:30.566487 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:30.571097 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:30.571712 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:30.581508 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:30.581970 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:30.582746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:30.589703 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:30.716260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:30.725005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:30.726570 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:30.727721 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-36111b42-aef2-4101-b3a2-b6a656d34164 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.177965 Jul 12 16:27:30.728295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 385/786] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:30 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:30.849120 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:30.856715 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d0d32149-55b8-4a86-86b7-1c89cf7bc355 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.289364 Jul 12 16:27:30.857316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 402/787] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:30 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:31.084162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:31.084901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:31.090853 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:31.091298 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:31.092089 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:31.092529 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:31.096594 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:31.232947 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:31.242749 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c93f55f0-c472-4370-9fea-1ac55860e0f9 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.162778 Jul 12 16:27:31.244212 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 386/788] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:31 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:31.254110 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-8fa84901-f2e2-41bf-b3ec-3caa2d717fc6 req-4f914d70-a2c9-4bb2-8871-4f3714edf7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5517e0ab-0a63-452e-95b1-53dea9fec2f7", "tag": "6f039bbe-a479-47f1-b01b-e2bdc0aa0973"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:31.262385 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8fa84901-f2e2-41bf-b3ec-3caa2d717fc6 req-4f914d70-a2c9-4bb2-8871-4f3714edf7f5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:31.263283 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-8fa84901-f2e2-41bf-b3ec-3caa2d717fc6 req-4f914d70-a2c9-4bb2-8871-4f3714edf7f5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:31.274133 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-8fa84901-f2e2-41bf-b3ec-3caa2d717fc6 req-4f914d70-a2c9-4bb2-8871-4f3714edf7f5 service nova] Creating event network-changed:6f039bbe-a479-47f1-b01b-e2bdc0aa0973 for instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 on hv-cinder-79760 Jul 12 16:27:31.280162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-8fa84901-f2e2-41bf-b3ec-3caa2d717fc6 req-4f914d70-a2c9-4bb2-8871-4f3714edf7f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123476 Jul 12 16:27:31.281539 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 403/789] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:31.746920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:31.748168 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:31.755779 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:31.756220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:31.757196 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:31.757627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:31.875555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:31.876159 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:31.882733 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:31.883394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:31.884341 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:31.885273 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:31.949632 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:31.958331 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:31.959853 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:31.961321 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-aed40c6d-b921-46d5-bc07-feaca69eddd5 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.218323 Jul 12 16:27:31.962700 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 387/790] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:31 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:32.030679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:32.039649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cd1bdec9-4218-4e7d-9c9d-21b7b45cdd4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.168686 Jul 12 16:27:32.040328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 404/791] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:31 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:32.176650 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-348757957"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:32.177219 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:32.183403 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.183860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.184628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.185093 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.260174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:32.260777 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:32.266730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.267174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.267926 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.268358 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.318111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.network.security_group_api [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Adding security group 4aa39eb2-5b79-4a19-8248-d094a1d4d6fb to port 6f039bbe-a479-47f1-b01b-e2bdc0aa0973 Jul 12 16:27:32.401249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:32.408722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-47c56a7b-890b-4a80-856c-993f96efec17 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.152340 Jul 12 16:27:32.409326 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 405/792] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:32 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:32.662789 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e113d1e6-e8a8-44c5-aa28-f53939851f29 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/action" status: 202 len: 0 microversion: 2.1 time: 0.490757 Jul 12 16:27:32.663394 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 388/793] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:27:32 2022] POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:27:32.673108 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:32.677129 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-caccc8f3-cd2a-4e49-bda8-3a8b7ee8853d req-5e530549-a8a0-4bc8-8234-43f685f1fc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5517e0ab-0a63-452e-95b1-53dea9fec2f7", "tag": "6f039bbe-a479-47f1-b01b-e2bdc0aa0973"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:32.677828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:32.684137 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.684798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.686784 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.687957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.692420 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-caccc8f3-cd2a-4e49-bda8-3a8b7ee8853d req-5e530549-a8a0-4bc8-8234-43f685f1fc3a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.693037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-caccc8f3-cd2a-4e49-bda8-3a8b7ee8853d req-5e530549-a8a0-4bc8-8234-43f685f1fc3a service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.713606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-caccc8f3-cd2a-4e49-bda8-3a8b7ee8853d req-5e530549-a8a0-4bc8-8234-43f685f1fc3a service nova] Creating event network-changed:6f039bbe-a479-47f1-b01b-e2bdc0aa0973 for instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 on hv-cinder-79760 Jul 12 16:27:32.723554 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-caccc8f3-cd2a-4e49-bda8-3a8b7ee8853d req-5e530549-a8a0-4bc8-8234-43f685f1fc3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052983 Jul 12 16:27:32.727567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 389/794] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:32.844995 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:32.854062 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a413354d-ec59-48da-9d06-d1e4727e337f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1641 microversion: 2.1 time: 0.186262 Jul 12 16:27:32.855694 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 406/795] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:32 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1641 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:32.981876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:32.983140 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:32.990408 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.990905 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:32.991700 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:32.992128 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:33.057636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:33.058277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:33.065113 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:33.065726 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:33.066503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:33.066934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:33.130842 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:33.144311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:33.146437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:33.147796 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a27b9b07-d550-419a-ae1e-c71f28ae5004 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1738 microversion: 2.20 time: 0.171776 Jul 12 16:27:33.148357 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 390/796] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:32 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:33.228178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:33.237375 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8ab766ee-2c35-4d11-9e92-61e7fe6c18a9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1266 microversion: 2.1 time: 0.183889 Jul 12 16:27:33.238497 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 407/797] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:33 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:33.426058 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:33.426591 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:33.432616 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:33.433438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:33.434424 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:33.435097 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:33.603335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:33.616897 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4f3e45d0-3d6f-41db-a3f7-c62ff4c4fc87 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.194103 Jul 12 16:27:33.617593 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 391/798] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:33 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:34.171687 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:34.172302 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:34.180191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.181031 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.182072 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.182506 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.256010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:34.257363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:34.265398 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.266226 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.267078 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.267687 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.396135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:34.405444 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:34.407503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:34.408807 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5d3afb66-9e73-466b-84ab-b10be98bac26 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1720 microversion: 2.20 time: 0.241127 Jul 12 16:27:34.409464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 408/799] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:34 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:34.634364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:34.635106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:34.640994 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.641480 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.642246 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.642680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.701431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:34.710100 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-39ff65bc-3346-4fdb-93dd-cb209763bcdb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1452 microversion: 2.1 time: 0.459037 Jul 12 16:27:34.711134 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 392/800] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:34 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1452 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:34.726386 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:34.727218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:34.734239 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.734933 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.736824 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.737307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.774626 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:34.782267 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ac517d4b-16f0-4f2d-a2f5-ac7db4cbb73f tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1521 microversion: 2.1 time: 0.151670 Jul 12 16:27:34.782846 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 409/801] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:34 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:34.962051 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-9c26b40d-f6f2-4be4-b791-88545afd0d13 req-794a9aec-b0fa-411b-98ed-15200c6f193e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97836b86-898a-44df-a529-4ebf4089cdbd", "name": "network-vif-deleted", "tag": "e68e6123-a7c0-4686-82ee-e2ff130f0da3"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:34.964280 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:34.970111 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-9c26b40d-f6f2-4be4-b791-88545afd0d13 req-794a9aec-b0fa-411b-98ed-15200c6f193e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:34.970549 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-9c26b40d-f6f2-4be4-b791-88545afd0d13 req-794a9aec-b0fa-411b-98ed-15200c6f193e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:34.971781 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f3ffabfa-7506-4800-b059-0aa31bd10ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1452 microversion: 2.1 time: 0.249356 Jul 12 16:27:34.972347 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 393/802] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:34 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1452 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:34.979664 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=100 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:34.981883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-9c26b40d-f6f2-4be4-b791-88545afd0d13 req-794a9aec-b0fa-411b-98ed-15200c6f193e service nova] Creating event network-vif-deleted:e68e6123-a7c0-4686-82ee-e2ff130f0da3 for instance 97836b86-898a-44df-a529-4ebf4089cdbd on hv-cinder-79760 Jul 12 16:27:34.986872 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-9c26b40d-f6f2-4be4-b791-88545afd0d13 req-794a9aec-b0fa-411b-98ed-15200c6f193e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028629 Jul 12 16:27:34.987447 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 410/803] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:35.428360 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:35.428941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:35.435371 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:35.435824 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:35.436578 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:35.437235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:35.567363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:35.575330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:35.576921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:35.578194 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-350defd5-d48a-41a2-a927-30e63edd1bb9 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1720 microversion: 2.20 time: 0.154360 Jul 12 16:27:35.578869 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 394/804] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:35 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:35.800017 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:35.800713 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:35.806907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:35.807352 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:35.808110 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:35.808546 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:35.875385 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e980def45e934114a2f0bc7081ffe8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641dd5eac4cf4352924c1610407bc5e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:35.883617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cd298897-3040-4c34-9f25-dbe26b2c6d00 tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 200 len: 1479 microversion: 2.1 time: 0.088257 Jul 12 16:27:35.884179 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 411/805] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:35 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 1479 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:36.577190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-1f0c1888-8d7d-4918-9297-2bd609fe847b req-0ceeec3e-00f6-4234-8f3b-678890d33be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3150f6-a658-4e6f-9692-d05e0d350072", "tag": "c8923a42-4682-40f9-9ae7-84a0f1a561d6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:36.587095 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1f0c1888-8d7d-4918-9297-2bd609fe847b req-0ceeec3e-00f6-4234-8f3b-678890d33be5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:36.587872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1f0c1888-8d7d-4918-9297-2bd609fe847b req-0ceeec3e-00f6-4234-8f3b-678890d33be5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:36.597431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:36.599135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:36.599296 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-1f0c1888-8d7d-4918-9297-2bd609fe847b req-0ceeec3e-00f6-4234-8f3b-678890d33be5 service nova] Creating event network-changed:c8923a42-4682-40f9-9ae7-84a0f1a561d6 for instance ac3150f6-a658-4e6f-9692-d05e0d350072 on hv-cinder-79760 Jul 12 16:27:36.604689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-1f0c1888-8d7d-4918-9297-2bd609fe847b req-0ceeec3e-00f6-4234-8f3b-678890d33be5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031862 Jul 12 16:27:36.605760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 395/806] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:36.620342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:36.621545 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:36.624793 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:36.625274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:36.804390 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:36.812403 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:36.814025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:36.815177 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7a0c1eab-6829-49fe-8a8f-57306cb03a9c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1723 microversion: 2.20 time: 0.221907 Jul 12 16:27:36.815731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 412/807] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:36 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:36.834610 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8b704501-889f-4377-b6fb-35174577de4d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6bbcabf-67f5-4d5c-bd7f-7b11898b5641"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:36.835806 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8b704501-889f-4377-b6fb-35174577de4d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:36.842091 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b704501-889f-4377-b6fb-35174577de4d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:36.842540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b704501-889f-4377-b6fb-35174577de4d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:36.843310 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b704501-889f-4377-b6fb-35174577de4d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:36.843755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8b704501-889f-4377-b6fb-35174577de4d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:36.900251 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:36.901301 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] [instance: 97836b86-898a-44df-a529-4ebf4089cdbd] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:36.907528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:36.908178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:36.909185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:36.909781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:36.927366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] HTTP exception thrown: Instance 97836b86-898a-44df-a529-4ebf4089cdbd could not be found. Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Request method failure captured: Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd HTTP/1.1 Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-m9H521Lwot7C4VNMRpEa_HUy-NTX4_b9y9l4PuZqmXLZcsqAcUQ7bUOxpW-oJ1ajmPFEx6GutFRwqjlevwHRXxsSy4gOu7W-XULrDyEP1Pp9N6W7sXsyolvNC1rEUUf2Ck_xXjAgGHAR-EVynuAvnUFGyUaD0j3ZJVxbqHFT67xM Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:27:36.929296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/641dd5eac4cf4352924c1610407bc5e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_641dd5eac4cf4352924c1610407bc5e3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 641dd5eac4cf4352924c1610407bc5e3 Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207561486 Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: e980def45e934114a2f0bc7081ffe8e3 Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207561486-project Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 97836b86-898a-44df-a529-4ebf4089cdbd could not be found. Jul 12 16:27:36.930636 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '97836b86-898a-44df-a529-4ebf4089cdbd'} Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97836b86-898a-44df-a529-4ebf4089cdbd could not be found. Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:27:36.931366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97836b86-898a-44df-a529-4ebf4089cdbd could not be found. Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97836b86-898a-44df-a529-4ebf4089cdbd could not be found. Jul 12 16:27:36.932520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:27:36.935165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] Returning 404 to user: Instance 97836b86-898a-44df-a529-4ebf4089cdbd could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:27:36.936209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1628cc8f-2955-421c-9f68-363899f570ab tempest-ServerRescueNegativeTestJSON-1207561486 tempest-ServerRescueNegativeTestJSON-1207561486-project] 10.222.0.20 "GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd" status: 404 len: 111 microversion: 2.1 time: 0.039952 Jul 12 16:27:36.937271 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 413/808] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:36 2022] GET /compute/v2.1/servers/97836b86-898a-44df-a529-4ebf4089cdbd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 16:27:37.280552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-daf439b8-7b2c-4067-a1fb-2bfad9602d1c req-22186600-5977-4834-96dc-dc2ae3e767ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e", "name": "network-vif-unplugged", "status": "completed", "tag": "77b11a6f-6e1f-4b01-ab67-32247582df08"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:37.294977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-daf439b8-7b2c-4067-a1fb-2bfad9602d1c req-22186600-5977-4834-96dc-dc2ae3e767ed service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:37.295427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-daf439b8-7b2c-4067-a1fb-2bfad9602d1c req-22186600-5977-4834-96dc-dc2ae3e767ed service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:37.308165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.compute.server_external_events [req-daf439b8-7b2c-4067-a1fb-2bfad9602d1c req-22186600-5977-4834-96dc-dc2ae3e767ed service nova] Unable to find a host for instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e. Dropping event network-vif-unplugged {{(pid=117791) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 16:27:37.309174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-daf439b8-7b2c-4067-a1fb-2bfad9602d1c req-22186600-5977-4834-96dc-dc2ae3e767ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.156380 Jul 12 16:27:37.309683 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 414/809] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 158 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 16:27:37.343747 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8b704501-889f-4377-b6fb-35174577de4d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.513694 Jul 12 16:27:37.344982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 396/810] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jul 12 16:27:36 2022] POST /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-volume_attachments => generated 188 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 16:27:37.490414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-208cbe65-6ffa-452e-ab77-c940e2eea8af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:37.491691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-208cbe65-6ffa-452e-ab77-c940e2eea8af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:37.499775 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-208cbe65-6ffa-452e-ab77-c940e2eea8af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:37.500526 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-208cbe65-6ffa-452e-ab77-c940e2eea8af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:37.501710 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-208cbe65-6ffa-452e-ab77-c940e2eea8af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:37.502344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-208cbe65-6ffa-452e-ab77-c940e2eea8af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:37.834501 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-208cbe65-6ffa-452e-ab77-c940e2eea8af tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-volume_attachments/c6bbcabf-67f5-4d5c-bd7f-7b11898b5641" status: 202 len: 0 microversion: 2.20 time: 0.349874 Jul 12 16:27:37.837427 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 415/811] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jul 12 16:27:37 2022] DELETE /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-volume_attachments/c6bbcabf-67f5-4d5c-bd7f-7b11898b5641 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:27:37.895823 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d2db95ee-6841-43db-9f28-f6ced21b823b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:37.896947 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d2db95ee-6841-43db-9f28-f6ced21b823b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:37.904459 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2db95ee-6841-43db-9f28-f6ced21b823b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:37.905165 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2db95ee-6841-43db-9f28-f6ced21b823b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:37.906086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2db95ee-6841-43db-9f28-f6ced21b823b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:37.906674 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d2db95ee-6841-43db-9f28-f6ced21b823b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:38.018384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d2db95ee-6841-43db-9f28-f6ced21b823b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "POST /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/action" status: 202 len: 0 microversion: 2.20 time: 0.126463 Jul 12 16:27:38.022047 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 397/812] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 16:27:37 2022] POST /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:27:38.027185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:38.027794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:38.034453 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:38.034964 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:38.035978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:38.036476 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:38.318540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:38.328823 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:38.330464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:38.332696 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8770ad20-1d24-4fab-bbd4-e00bdddea313 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1671 microversion: 2.20 time: 0.308748 Jul 12 16:27:38.336431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 416/813] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:38 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1671 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:39.351189 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:39.352443 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:39.359360 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:39.360358 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:39.361879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:39.362555 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:39.585619 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:39.593891 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:39.595630 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:39.596998 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b1a11aed-6cea-41bc-861b-6187a5a2a25e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.250261 Jul 12 16:27:39.597825 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 398/814] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:39 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:40.616990 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:40.618014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:40.628768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:40.632224 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:40.636488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:40.637163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:41.081199 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:41.090585 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:41.092122 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:41.099486 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4f9529f8-0db6-45b5-b2ab-120b664044b2 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.481037 Jul 12 16:27:41.100008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 417/815] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:40 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:41.182445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7d218c68-ecf3-4ad0-b409-b3d9a4e074b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:41.183626 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7d218c68-ecf3-4ad0-b409-b3d9a4e074b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:41.191638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d218c68-ecf3-4ad0-b409-b3d9a4e074b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:41.192469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d218c68-ecf3-4ad0-b409-b3d9a4e074b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:41.193512 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d218c68-ecf3-4ad0-b409-b3d9a4e074b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:41.194161 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7d218c68-ecf3-4ad0-b409-b3d9a4e074b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:41.241189 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7d218c68-ecf3-4ad0-b409-b3d9a4e074b3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/ips" status: 200 len: 150 microversion: 2.1 time: 0.179104 Jul 12 16:27:41.242133 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 399/816] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:27:41 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/ips => generated 150 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:42.121457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:42.123201 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:42.130389 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:42.131212 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:42.132050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:42.132368 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:42.308324 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:42.321996 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:42.324564 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:42.326417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-14bc7cb8-6e0e-44d6-8678-3bce1bf0f549 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.210661 Jul 12 16:27:42.327535 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 418/817] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:42 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:42.817235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7ae14209-94f5-4809-b0f5-b4a4440a5cf3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbcd7e48-9ae8-48e6-9327-9a1a360e88e8"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:42.819116 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7ae14209-94f5-4809-b0f5-b4a4440a5cf3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:42.829730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ae14209-94f5-4809-b0f5-b4a4440a5cf3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:42.834641 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ae14209-94f5-4809-b0f5-b4a4440a5cf3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:42.835628 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ae14209-94f5-4809-b0f5-b4a4440a5cf3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:42.836220 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ae14209-94f5-4809-b0f5-b4a4440a5cf3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:43.349251 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:43.350011 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:43.366430 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:43.367114 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:43.368274 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:43.369127 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:44.026108 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:44.035458 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:44.037810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:44.047195 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a041483d-6d5f-4e4c-acf0-9409a4ffea03 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.697199 Jul 12 16:27:44.048055 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 419/818] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:43 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:45.067076 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:45.068455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:45.075241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:45.075934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:45.076710 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:45.077176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:45.402203 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:45.412176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:45.416204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:45.419378 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-00c0955b-4b82-4008-aba4-30d70cf9a201 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.357044 Jul 12 16:27:45.425349 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 420/819] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:45 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:46.440552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:46.442139 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:46.453031 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:46.454633 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:46.455770 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:46.457706 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:46.708228 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:46.717499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:46.719743 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:46.721226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ffeab1cb-5d3b-4b88-8ce7-b1dbd04d2a07 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.285199 Jul 12 16:27:46.723130 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 421/820] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:46 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:47.741437 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:47.743032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:47.750300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:47.751110 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:47.752106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:47.752891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:47.974634 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:47.985132 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:47.987083 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:47.989493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ff22211c-968a-42f8-8850-3bc8d20ed7bd tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.251866 Jul 12 16:27:47.990877 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 422/821] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:47 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:48.599724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b6247a4d-0cf8-4f11-89c9-2852312fcbfb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'create', calling method: .version_select at 0x7f1da59da430>, body: {"keypair": {"name": "tempest-keypair-1938184238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfxukHgc4533S6IXUD/7uZdqPcikpNfYtYMM/XTVxM40ih63tnoc85GsaDq9PVPytzyfu06yf/EYlSehhexVJ8mvIbPHdgpzmI1HT3b5JYp43jfO5brir8+wlkq9vc94A=="}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:48.622722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-b6247a4d-0cf8-4f11-89c9-2852312fcbfb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for project 356781184b3e4b409522e2a81d701fb5. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:27:48.626613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-b6247a4d-0cf8-4f11-89c9-2852312fcbfb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for user 0fd410fff845482ab3f04c7ccacf0d0a and project 356781184b3e4b409522e2a81d701fb5. Resources: {'key_pairs'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:27:48.657506 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b6247a4d-0cf8-4f11-89c9-2852312fcbfb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194064 Jul 12 16:27:48.658117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 423/822] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:27:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:49.008311 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:49.009008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:49.017731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:49.018454 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:49.020383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:49.020901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:49.224798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:49.233761 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:49.235587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:49.236783 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-64dcb0ba-4140-4e8c-ac10-80802bdb4e9d tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.232351 Jul 12 16:27:49.239550 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 424/823] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:49 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:49.924838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:49.989955 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1240000340", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6031eeb-c9f6-49cf-b212-2e93a4763d32"}], "security_groups": [{"name": "tempest-securitygroup--963533671"}], "key_name": "tempest-keypair-1938184238", "user_data": "}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:50.075641 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7ae14209-94f5-4809-b0f5-b4a4440a5cf3 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "POST /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.265682 Jul 12 16:27:50.080876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 400/824] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:27:42 2022] POST /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments => generated 194 bytes in 7272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:50.111949 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] validate_networks() for [('c6031eeb-c9f6-49cf-b212-2e93a4763d32', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:27:50.256522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:50.259126 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:50.264219 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:50.279684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:50.280236 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:50.281076 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:50.281545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:50.468647 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:50.477324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:50.478835 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:50.480015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b649a853-725f-448c-bb77-814c7297dc51 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.228007 Jul 12 16:27:50.480644 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 401/825] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:50 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:50.610532 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:27:50.610954 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:27:50.611422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:27:50.611826 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:27:50.612317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:27:50.621278 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:50.621725 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:50.622514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:50.622946 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:50.641110 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for project 356781184b3e4b409522e2a81d701fb5. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:27:50.649970 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for user 0fd410fff845482ab3f04c7ccacf0d0a and project 356781184b3e4b409522e2a81d701fb5. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:27:50.665498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:27:50.668035 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:27:50.721891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-edc7054f-1718-4192-b76a-f5a7a727cf1a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.738944 Jul 12 16:27:50.723442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 425/826] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:27:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:27:50.733728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-04b31783-aec5-4e05-b460-382d10495006 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:50.734972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-04b31783-aec5-4e05-b460-382d10495006 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:50.823180 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-04b31783-aec5-4e05-b460-382d10495006 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:50.830871 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-04b31783-aec5-4e05-b460-382d10495006 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1238 microversion: 2.1 time: 0.101007 Jul 12 16:27:50.832694 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 402/827] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:50 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:51.501342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:51.501893 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:51.505626 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:51.514607 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:51.515414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:51.516805 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:51.517622 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:51.694019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:51.703668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:51.705475 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:51.706706 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7ceb0ac1-8829-4538-95d7-8331c7b3908b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.210138 Jul 12 16:27:51.718133 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 426/828] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:51 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:51.852819 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:51.853466 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:51.868177 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:51.868627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:51.869509 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:51.869944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:51.988305 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:52.000060 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f919a0fa-f3d9-42c1-a1fc-78a900375874 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1298 microversion: 2.1 time: 0.148478 Jul 12 16:27:52.000965 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 403/829] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:51 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:52.725604 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:52.733497 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:52.741268 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:52.741721 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:52.742502 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:52.742944 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:52.882847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:52.892373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:52.895166 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:52.896629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4e4295b6-42f9-4aa0-b55d-747d98c89f9e tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.175647 Jul 12 16:27:52.897310 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 427/830] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:52 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:53.018927 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:53.020302 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:53.026891 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:53.027416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:53.028281 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:53.028787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:53.223577 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:53.231135 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ceea1361-182e-4c6d-9a3d-58cc5f7ad2a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.216780 Jul 12 16:27:53.232008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 404/831] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:53 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:53.510860 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-5347df89-6036-45ae-a96b-60d77149be72 req-b29b76e1-a8c0-4815-9e1f-eab60ce5aabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854f546f-6c0c-4db8-bc32-286169fe686b", "tag": "4f70e2bf-0cb8-4109-8ed2-f0b8046999dc"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:53.530188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-5347df89-6036-45ae-a96b-60d77149be72 req-b29b76e1-a8c0-4815-9e1f-eab60ce5aabd service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:53.530760 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-5347df89-6036-45ae-a96b-60d77149be72 req-b29b76e1-a8c0-4815-9e1f-eab60ce5aabd service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:53.542767 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:53.550531 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-5347df89-6036-45ae-a96b-60d77149be72 req-b29b76e1-a8c0-4815-9e1f-eab60ce5aabd service nova] Creating event network-changed:4f70e2bf-0cb8-4109-8ed2-f0b8046999dc for instance 854f546f-6c0c-4db8-bc32-286169fe686b on hv-cinder-79760 Jul 12 16:27:53.566381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-5347df89-6036-45ae-a96b-60d77149be72 req-b29b76e1-a8c0-4815-9e1f-eab60ce5aabd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059362 Jul 12 16:27:53.567365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 428/832] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:53.914715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:53.915341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:53.921206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:53.921657 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:53.922412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:53.922840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:54.054463 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:54.062372 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:54.063878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:54.065018 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c83be5ae-9c43-47dd-879c-3d0eb1730235 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.154188 Jul 12 16:27:54.065603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 405/833] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:53 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:54.249503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:54.250186 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:54.257898 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:54.258369 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:54.259124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:54.259557 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:54.386365 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:54.393935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f2ef893f-705a-417a-b4af-ce2b69b84906 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.149120 Jul 12 16:27:54.394487 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 429/834] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:54 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:55.083840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:55.084449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:55.091103 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:55.091546 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:55.092488 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:55.092937 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:55.150764 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-216e3658-6dc5-4d3f-9964-2ac4605a5fa3 req-3eadaba0-a45f-4be4-a275-a9f0dae9d752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e", "name": "network-vif-plugged", "status": "completed", "tag": "77b11a6f-6e1f-4b01-ab67-32247582df08"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:55.160249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-216e3658-6dc5-4d3f-9964-2ac4605a5fa3 req-3eadaba0-a45f-4be4-a275-a9f0dae9d752 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:55.163703 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-216e3658-6dc5-4d3f-9964-2ac4605a5fa3 req-3eadaba0-a45f-4be4-a275-a9f0dae9d752 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:55.175940 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-216e3658-6dc5-4d3f-9964-2ac4605a5fa3 req-3eadaba0-a45f-4be4-a275-a9f0dae9d752 service nova] Creating event network-vif-plugged:77b11a6f-6e1f-4b01-ab67-32247582df08 for instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e on hv-cinder-79760 Jul 12 16:27:55.181903 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-216e3658-6dc5-4d3f-9964-2ac4605a5fa3 req-3eadaba0-a45f-4be4-a275-a9f0dae9d752 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Jul 12 16:27:55.183671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 430/835] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:55.412231 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:55.418650 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:55.425911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:55.426624 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:55.427586 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:55.428187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:55.566201 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:55.573891 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-89cf03d3-5162-4333-af96-f82a8b8e34b8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.166855 Jul 12 16:27:55.574458 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 431/836] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:55 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:55.584312 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:55.592218 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:55.593760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:55.594899 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f8e58c25-c18e-46ee-b07c-acdbca170d5c tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.515058 Jul 12 16:27:55.595458 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 406/837] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:55 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:56.590383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:56.590915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:56.597973 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:56.598416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:56.599163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:56.599590 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:56.614148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:56.615074 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:56.621408 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:56.621851 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:56.622607 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:56.623037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:56.743469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:56.750759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-65eb623a-70ea-47a8-a780-3997f4e50ba4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.164276 Jul 12 16:27:56.751322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 432/838] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:56 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:56.756289 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:56.764268 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:56.765815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:56.767005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-40a16c08-1708-4173-a91f-76f452251e57 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1729 microversion: 2.20 time: 0.156651 Jul 12 16:27:56.767558 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 407/839] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:56 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 16:27:57.753809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:57.754306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:57.760609 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.761135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.761870 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.762261 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.767076 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:57.767692 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:57.774785 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.775175 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.775948 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.776386 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.852396 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lazy-loading 'services' on Instance uuid b4a0659c-673b-42a0-a8e1-9caabb136980 {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:27:57.924683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:57.931932 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-772e0b0c-b9c1-4fef-ac6b-26046712b3d9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.168665 Jul 12 16:27:57.932289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-15792fc9-111c-48e5-8815-b3f0ef05373b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments/dbcd7e48-9ae8-48e6-9327-9a1a360e88e8" status: 202 len: 0 microversion: 2.1 time: 0.182700 Jul 12 16:27:57.932651 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 408/840] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:57 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:27:57.933304 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 433/841] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:27:57 2022] DELETE /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments/dbcd7e48-9ae8-48e6-9327-9a1a360e88e8 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:27:57.937544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:57.938307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:57.942008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d9c9e4a5-c193-4d1b-b0c6-bcca4f5fcee6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:57.943024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d9c9e4a5-c193-4d1b-b0c6-bcca4f5fcee6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:57.944846 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.945334 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.946127 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.946557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.949901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9c9e4a5-c193-4d1b-b0c6-bcca4f5fcee6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.950425 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9c9e4a5-c193-4d1b-b0c6-bcca4f5fcee6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.951382 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9c9e4a5-c193-4d1b-b0c6-bcca4f5fcee6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:57.952045 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d9c9e4a5-c193-4d1b-b0c6-bcca4f5fcee6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:57.988751 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d9c9e4a5-c193-4d1b-b0c6-bcca4f5fcee6 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051267 Jul 12 16:27:57.989673 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 434/842] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:27:57 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:27:58.081183 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:58.089117 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:58.090634 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:58.091780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cfd968ba-7857-4142-a95a-1f096e7688be tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1716 microversion: 2.20 time: 0.157865 Jul 12 16:27:58.092346 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 409/843] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:27:57 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:27:58.948373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:58.948990 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:58.955578 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:58.955968 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:58.956729 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:58.957198 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.000431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-35d06992-1785-4c11-b95a-5335ea4fc722 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:59.001453 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-35d06992-1785-4c11-b95a-5335ea4fc722 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:59.008491 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-35d06992-1785-4c11-b95a-5335ea4fc722 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:59.008935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-35d06992-1785-4c11-b95a-5335ea4fc722 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.009731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-35d06992-1785-4c11-b95a-5335ea4fc722 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:59.010163 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-35d06992-1785-4c11-b95a-5335ea4fc722 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.053991 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-35d06992-1785-4c11-b95a-5335ea4fc722 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057418 Jul 12 16:27:59.054729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 410/844] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:27:58 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 16:27:59.096495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:59.106222 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-66e512b5-8d79-47f9-8f86-b27d16f844fb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.161544 Jul 12 16:27:59.106791 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 435/845] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:58 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:27:59.125011 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:59.125919 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:59.135380 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:59.136099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.137006 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:59.137563 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.166627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:27:59.204062 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-d582e9f3-450c-46dc-80c1-9d2ab560037e req-81d4f40b-d322-499a-a139-2e3bd95b0775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854f546f-6c0c-4db8-bc32-286169fe686b", "name": "network-vif-plugged", "status": "completed", "tag": "4f70e2bf-0cb8-4109-8ed2-f0b8046999dc"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:27:59.214261 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-d582e9f3-450c-46dc-80c1-9d2ab560037e req-81d4f40b-d322-499a-a139-2e3bd95b0775 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:59.214934 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-d582e9f3-450c-46dc-80c1-9d2ab560037e req-81d4f40b-d322-499a-a139-2e3bd95b0775 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.228954 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-d582e9f3-450c-46dc-80c1-9d2ab560037e req-81d4f40b-d322-499a-a139-2e3bd95b0775 service nova] Creating event network-vif-plugged:4f70e2bf-0cb8-4109-8ed2-f0b8046999dc for instance 854f546f-6c0c-4db8-bc32-286169fe686b on hv-cinder-79760 Jul 12 16:27:59.233907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-d582e9f3-450c-46dc-80c1-9d2ab560037e req-81d4f40b-d322-499a-a139-2e3bd95b0775 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036643 Jul 12 16:27:59.235499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 436/846] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:27:59.267868 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9ae64e8b-dd79-47a5-9b43-128203f8163d tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 204 len: 0 microversion: 2.1 time: 0.146212 Jul 12 16:27:59.269652 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 411/847] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:27:59 2022] DELETE /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:27:59.278724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:27:59.279722 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:27:59.287663 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:59.288176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.288991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:27:59.289469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:27:59.416049 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:27:59.423499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1eea2cae-2ea1-4b81-a7c9-4a369b23c1c4 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1683 microversion: 2.1 time: 0.148926 Jul 12 16:27:59.424062 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 437/848] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:27:59 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:00.127943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:00.129154 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:00.135612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:00.136059 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:00.136812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:00.137277 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:00.270427 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:00.277670 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d8d27ab5-f758-43d9-9a4e-925c88104ea0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.153986 Jul 12 16:28:00.278234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 412/849] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:00 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:00.440508 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:00.441969 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:00.448530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:00.448973 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:00.449827 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:00.450261 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:00.575030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:00.582404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-31a69668-72e3-458f-b533-f6b2bdfec789 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1683 microversion: 2.1 time: 0.146178 Jul 12 16:28:00.582959 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 438/850] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:00 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:01.293479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:01.294084 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:01.296491 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:01.302147 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:01.302594 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:01.303353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:01.303786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:01.517571 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:01.525605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f01f7aba-8ff9-4289-b67c-d41cfbd62ac5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1363 microversion: 2.1 time: 0.235933 Jul 12 16:28:01.526172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 413/851] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:01 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:01.598984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:01.599617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:01.601560 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:01.602304 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=10 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:01.608758 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:01.609476 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:01.610237 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:01.610707 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:01.743415 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:01.751303 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4f83c576-7991-49c0-9344-f82dbab32d89 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1683 microversion: 2.1 time: 0.156281 Jul 12 16:28:01.751874 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 439/852] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:01 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:02.070006 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-1774ee86-5fff-49ac-930f-52f61c7e282c req-edae486d-4481-4c17-9b14-ad747a90c07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a0659c-673b-42a0-a8e1-9caabb136980", "name": "network-vif-deleted", "tag": "d61440e9-3af1-4cd0-9fc6-79183663f5a1"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:02.078027 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1774ee86-5fff-49ac-930f-52f61c7e282c req-edae486d-4481-4c17-9b14-ad747a90c07e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.078407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1774ee86-5fff-49ac-930f-52f61c7e282c req-edae486d-4481-4c17-9b14-ad747a90c07e service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.089265 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-1774ee86-5fff-49ac-930f-52f61c7e282c req-edae486d-4481-4c17-9b14-ad747a90c07e service nova] Creating event network-vif-deleted:d61440e9-3af1-4cd0-9fc6-79183663f5a1 for instance b4a0659c-673b-42a0-a8e1-9caabb136980 on hv-cinder-79760 Jul 12 16:28:02.094046 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-1774ee86-5fff-49ac-930f-52f61c7e282c req-edae486d-4481-4c17-9b14-ad747a90c07e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028348 Jul 12 16:28:02.094633 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 414/853] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:02.542623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:02.543147 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:02.549596 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.550052 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.550828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.551277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.685936 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:02.693632 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e1c2914b-1121-41f6-bf43-02d860666bf8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1550 microversion: 2.1 time: 0.155162 Jul 12 16:28:02.694209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 440/854] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:02 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:02.711063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-66300c33-bd3d-4fa4-9c22-1e9219d3e868 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:02.711651 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-66300c33-bd3d-4fa4-9c22-1e9219d3e868 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:02.717917 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-66300c33-bd3d-4fa4-9c22-1e9219d3e868 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.718379 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-66300c33-bd3d-4fa4-9c22-1e9219d3e868 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.719152 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-66300c33-bd3d-4fa4-9c22-1e9219d3e868 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.719592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-66300c33-bd3d-4fa4-9c22-1e9219d3e868 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.771667 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:02.772294 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:02.778645 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.779090 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.780054 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.780493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.804304 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-66300c33-bd3d-4fa4-9c22-1e9219d3e868 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098364 Jul 12 16:28:02.805016 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 415/855] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:28:02 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:02.816844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:02.817512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:02.818241 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lazy-loading 'fault' on Instance uuid b4a0659c-673b-42a0-a8e1-9caabb136980 {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:28:02.894481 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8fa75fd97a4c7dacc1ab46b14b8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae94369af249a9a7d80185508089d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:02.903412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5740840d-8ffc-4065-aacc-18d4d25e1343 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 200 len: 1332 microversion: 2.1 time: 0.138327 Jul 12 16:28:02.904333 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 441/856] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:02 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:28:03.920303 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:03.921077 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:03.927015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:03.927462 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:03.928216 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:03.928647 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:03.942116 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 HTTP/1.1 Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:03.943731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:03.945172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'b4a0659c-673b-42a0-a8e1-9caabb136980'} Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:03.945972 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:03.947243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:03.948384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:03.948384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2336a8e9-abac-45fe-9a22-fa78debfdfc7 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 404 len: 111 microversion: 2.1 time: 0.029167 Jul 12 16:28:03.948384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 416/857] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:03 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:03.954216 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0f8fe204-95f5-4d6d-a228-1a5f3ad3fdba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '.version_select at 0x7f1da58f94c0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:03.971916 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0f8fe204-95f5-4d6d-a228-1a5f3ad3fdba tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466280650" status: 202 len: 0 microversion: 2.1 time: 0.021470 Jul 12 16:28:03.972642 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 442/858] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 16:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466280650 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:28:04.047440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-300e69dc-6dc5-48b5-b993-1a38ad0b9455 req-52a7a420-7969-4cad-a5d7-1c43cd5bc1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854f546f-6c0c-4db8-bc32-286169fe686b", "tag": "4f70e2bf-0cb8-4109-8ed2-f0b8046999dc"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:04.057551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-300e69dc-6dc5-48b5-b993-1a38ad0b9455 req-52a7a420-7969-4cad-a5d7-1c43cd5bc1ad service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:04.058081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-300e69dc-6dc5-48b5-b993-1a38ad0b9455 req-52a7a420-7969-4cad-a5d7-1c43cd5bc1ad service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:04.070167 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-300e69dc-6dc5-48b5-b993-1a38ad0b9455 req-52a7a420-7969-4cad-a5d7-1c43cd5bc1ad service nova] Creating event network-changed:4f70e2bf-0cb8-4109-8ed2-f0b8046999dc for instance 854f546f-6c0c-4db8-bc32-286169fe686b on hv-cinder-79760 Jul 12 16:28:04.079031 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-300e69dc-6dc5-48b5-b993-1a38ad0b9455 req-52a7a420-7969-4cad-a5d7-1c43cd5bc1ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035930 Jul 12 16:28:04.079952 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 417/859] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:05.133969 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ad8d3748-af4b-4179-882d-d259ba5d01c0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:05.134902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ad8d3748-af4b-4179-882d-d259ba5d01c0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:05.141701 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ad8d3748-af4b-4179-882d-d259ba5d01c0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.142148 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ad8d3748-af4b-4179-882d-d259ba5d01c0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.142905 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ad8d3748-af4b-4179-882d-d259ba5d01c0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.143338 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ad8d3748-af4b-4179-882d-d259ba5d01c0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.214200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ad8d3748-af4b-4179-882d-d259ba5d01c0 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/action" status: 202 len: 0 microversion: 2.1 time: 0.084385 Jul 12 16:28:05.214977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 443/860] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:28:05 2022] POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:28:05.224545 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:05.225286 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:05.232348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.232917 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.233768 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.234455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.239310 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:05.467605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:05.476440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5c1f1a84-3020-46aa-b998-c8018764871f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1752 microversion: 2.1 time: 0.257112 Jul 12 16:28:05.477019 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 418/861] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:05 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1752 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:05.810231 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:05.810823 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:05.816945 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.817420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.818178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.818608 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.832234 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 HTTP/1.1 Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:05.833907 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.835414 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'b4a0659c-673b-42a0-a8e1-9caabb136980'} Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:05.837417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.838828 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.840059 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:05.840059 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c998ca1a-38b8-4830-b7a3-4d4cbdbdc9db tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 404 len: 111 microversion: 2.1 time: 0.029246 Jul 12 16:28:05.840059 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 444/862] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:28:05 2022] DELETE /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:05.843683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:05.844305 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: b4a0659c-673b-42a0-a8e1-9caabb136980] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:05.850984 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.851436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.852200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:05.852646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:05.865877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 HTTP/1.1 Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:05.867497 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.869036 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'b4a0659c-673b-42a0-a8e1-9caabb136980'} Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:05.872722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. Jul 12 16:28:05.873957 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:05.875451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance b4a0659c-673b-42a0-a8e1-9caabb136980 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:05.875451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-621f168b-826f-4ca5-8b8c-b1189b71f382 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980" status: 404 len: 111 microversion: 2.1 time: 0.029109 Jul 12 16:28:05.875451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 419/863] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:05 2022] GET /compute/v2.1/servers/b4a0659c-673b-42a0-a8e1-9caabb136980 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 16:28:06.494264 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:06.494869 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:06.501558 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:06.502004 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:06.502756 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:06.503788 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:06.641189 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:06.648885 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7ee3d01a-f272-44d2-be9c-89ebda70cdf6 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.158460 Jul 12 16:28:06.649483 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 445/864] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:06 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:07.001165 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:07.001696 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:07.008177 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.008625 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.009421 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.009855 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.023435 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 HTTP/1.1 Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:07.024941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.026479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'c78b6a91-9299-4181-925f-3967e7df03e5'} Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:07.027355 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.028761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.030182 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:07.030182 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e1e383a4-e1e6-4ae5-a9a5-d139dcc39b79 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 404 len: 111 microversion: 2.1 time: 0.029084 Jul 12 16:28:07.030182 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 420/865] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:28:06 2022] DELETE /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:07.035478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:07.036124 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: c78b6a91-9299-4181-925f-3967e7df03e5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:07.042106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.042554 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.043312 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.043747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.056525 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 HTTP/1.1 Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:07.058073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.059600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'c78b6a91-9299-4181-925f-3967e7df03e5'} Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:07.060685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. Jul 12 16:28:07.062153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.063416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance c78b6a91-9299-4181-925f-3967e7df03e5 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:07.063416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ea38c6e3-e278-4ded-9980-cfa07276b751 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5" status: 404 len: 111 microversion: 2.1 time: 0.028598 Jul 12 16:28:07.063416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 446/866] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:07 2022] GET /compute/v2.1/servers/c78b6a91-9299-4181-925f-3967e7df03e5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 16:28:07.067641 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:07.068138 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:07.074267 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.074715 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.075470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.075903 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.089396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 HTTP/1.1 Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:07.090934 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.093272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'cc4e4cb1-5677-4912-80a3-18b65ae45b20'} Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:07.094206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.095653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.098738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:07.098738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8487b0bd-4346-468f-9767-7e64e63b0b2c tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 404 len: 111 microversion: 2.1 time: 0.028517 Jul 12 16:28:07.098738 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 421/867] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:28:07 2022] DELETE /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:07.101958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:07.102572 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: cc4e4cb1-5677-4912-80a3-18b65ae45b20] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:07.108695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.109442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.110209 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.110647 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.114073 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:07.128978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 HTTP/1.1 Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:07.130412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.131763 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'cc4e4cb1-5677-4912-80a3-18b65ae45b20'} Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:07.132514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. Jul 12 16:28:07.134168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:07.135364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance cc4e4cb1-5677-4912-80a3-18b65ae45b20 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:07.135364 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ee62ab61-1817-499f-ae91-7a27f0d5f4ec tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20" status: 404 len: 111 microversion: 2.1 time: 0.033820 Jul 12 16:28:07.135549 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 447/868] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:07 2022] GET /compute/v2.1/servers/cc4e4cb1-5677-4912-80a3-18b65ae45b20 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:07.666038 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:07.666677 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:07.672622 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.673089 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.673839 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:07.674269 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:07.816854 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:07.824818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-be1e7740-b13c-40a1-a43a-aeb9d19baa7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.162608 Jul 12 16:28:07.825406 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 422/869] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:07 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:08.275482 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:08.276026 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:08.282929 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:08.283374 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:08.284634 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:08.285089 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:08.298004 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b HTTP/1.1 Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:08.299517 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.301593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b'} Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:08.302344 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.303935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.305601 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:08.305601 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1dca93c0-9be0-4d65-9d31-f207f5a033f9 tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 404 len: 111 microversion: 2.1 time: 0.030023 Jul 12 16:28:08.305601 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 448/870] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:28:08 2022] DELETE /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:08.309931 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:08.310538 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] [instance: 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:08.317118 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:08.317562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:08.318317 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:08.318755 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:08.331790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] HTTP exception thrown: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Request method failure captured: Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b HTTP/1.1 Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kjp3rfpZp96426audNKniC-8gugzCniOLcHwMvGY0akQogykdCpMt1e2X8T-H0ILoZfdnc8KK9lRnNPkrZjCfbPPE_q0eFMUU_Ap4OTW8EpV89J9v4bW9WWOLT3tPfVueFnY45qJzPNDryaMPU8kF1lcx7OqUNb0qj3amwbiFXeU Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:08.333348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5ae94369af249a9a7d80185508089d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5ae94369af249a9a7d80185508089d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5ae94369af249a9a7d80185508089d6 Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956724151 Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: ff8fa75fd97a4c7dacc1ab46b14b8b76 Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1956724151-project Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.334893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b'} Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:08.335771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. Jul 12 16:28:08.337330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:08.338758 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] Returning 404 to user: Instance 60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:08.338758 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b8cc5ed6-6ef7-460f-8379-08bbc807f14b tempest-AttachVolumeNegativeTest-1956724151 tempest-AttachVolumeNegativeTest-1956724151-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b" status: 404 len: 111 microversion: 2.1 time: 0.028546 Jul 12 16:28:08.338758 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 423/871] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:08 2022] GET /compute/v2.1/servers/60e5fa79-e5c0-46e9-82c9-7ad7e4eead9b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:08.841731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:08.842417 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:08.848912 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:08.849394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:08.850162 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:08.850603 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:09.076859 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:09.085804 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-fa22999f-c4d5-4351-ab92-73a1f447470e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.247906 Jul 12 16:28:09.086368 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 449/872] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:08 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:10.105478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:10.106511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:10.114969 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:10.115417 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:10.116222 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:10.116660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:10.351684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:10.360835 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5e487ce9-9c3c-4ab3-afe5-b589c147152f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.261094 Jul 12 16:28:10.361446 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 424/873] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:10 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:11.381220 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:11.381836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:11.388463 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:11.388911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:11.389908 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:11.390519 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:11.556937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:11.566176 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-010d8af8-f669-4d75-9a87-24dc6ed4b83e tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.188456 Jul 12 16:28:11.566682 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 450/874] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:11 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:12.583086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:12.583702 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:12.590209 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:12.590690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:12.591490 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:12.591931 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:12.742742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:12.750753 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ad1a852e-3f2c-40fb-abad-2276e22c5507 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.171998 Jul 12 16:28:12.751419 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 425/875] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:12 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:12.767804 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ec6d9c15-7f82-4a40-b5b8-b3eb9c66dbe8 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Action: 'create', calling method: .version_select at 0x7f1da58b44c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1963633401", "metadata": {"Type": "work"}}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ec6d9c15-7f82-4a40-b5b8-b3eb9c66dbe8 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Request method failure captured: Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 122 Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaEcyt6t2XdONE7rUqyqqw0ukgftI6Af0_lSVWb8F8COSQ6VCLlmT8clvUdh7285GI-1cfZ5aDPtstQxipUFQHWCoQ-Bvpgx0RYp9ILJfvWsGbmRhU8NZy1cQy4xHqOwLngc1-8BK-8mhJ6ERs8_nEpWGGQjrst7fOOGeblz6TA6nzE Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:12.796064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9a7b9ab8ee46ada724d3759e710413", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 9b6acc2c539d465cbed6f92d1ca0aae5 Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1963633401", "metadata": {"Type": "work"}}} Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: Jul 12 16:28:12.797691 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1963633401', 'metadata': {'Type': 'work'}}}} Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise error Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:12.798842 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 16:28:12.800361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 16:28:12.801886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 16:28:12.801886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.801886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ec6d9c15-7f82-4a40-b5b8-b3eb9c66dbe8 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:12.801886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ec6d9c15-7f82-4a40-b5b8-b3eb9c66dbe8 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147824 Jul 12 16:28:12.801886 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 451/876] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 16:28:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:12.806879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e08518a1-c284-47a0-b1f4-b712a8db165c tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Action: 'create', calling method: .version_select at 0x7f1daa213550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1921689023", "metadata": {"Type": "work"}}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e08518a1-c284-47a0-b1f4-b712a8db165c tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Request method failure captured: Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 120 Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaEcyt6t2XdONE7rUqyqqw0ukgftI6Af0_lSVWb8F8COSQ6VCLlmT8clvUdh7285GI-1cfZ5aDPtstQxipUFQHWCoQ-Bvpgx0RYp9ILJfvWsGbmRhU8NZy1cQy4xHqOwLngc1-8BK-8mhJ6ERs8_nEpWGGQjrst7fOOGeblz6TA6nzE Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:12.810037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9a7b9ab8ee46ada724d3759e710413", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 9b6acc2c539d465cbed6f92d1ca0aae5 Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1921689023", "metadata": {"Type": "work"}}} Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: Jul 12 16:28:12.811511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1921689023', 'metadata': {'Type': 'work'}}}} Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise error Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi '0' Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:12.812605 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 16:28:12.814192 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 16:28:12.816148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 16:28:12.816148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.816148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e08518a1-c284-47a0-b1f4-b712a8db165c tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:12.816148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e08518a1-c284-47a0-b1f4-b712a8db165c tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008366 Jul 12 16:28:12.816148 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 426/877] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 16:28:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:12.820431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-af8a458a-b762-4294-bb9e-615af66074e3 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Action: 'create', calling method: .version_select at 0x7f1da58c2d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-439195744", "metadata": {"Type": "work"}}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-af8a458a-b762-4294-bb9e-615af66074e3 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Request method failure captured: Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 118 Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaEcyt6t2XdONE7rUqyqqw0ukgftI6Af0_lSVWb8F8COSQ6VCLlmT8clvUdh7285GI-1cfZ5aDPtstQxipUFQHWCoQ-Bvpgx0RYp9ILJfvWsGbmRhU8NZy1cQy4xHqOwLngc1-8BK-8mhJ6ERs8_nEpWGGQjrst7fOOGeblz6TA6nzE Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:12.822735 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9a7b9ab8ee46ada724d3759e710413", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 9b6acc2c539d465cbed6f92d1ca0aae5 Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-439195744", "metadata": {"Type": "work"}}} Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: Jul 12 16:28:12.824249 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-439195744', 'metadata': {'Type': 'work'}}}} Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise error Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi '' Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:12.825377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 16:28:12.826977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 16:28:12.828571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 16:28:12.828571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.828571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-af8a458a-b762-4294-bb9e-615af66074e3 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:12.828571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-af8a458a-b762-4294-bb9e-615af66074e3 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007402 Jul 12 16:28:12.828571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 452/878] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 16:28:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:12.833348 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0bf52964-1fae-4985-a734-0f93992fc66f tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Calling method '.version_select at 0x7f1da58070d0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:12.860309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-0bf52964-1fae-4985-a734-0f93992fc66f tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] HTTP exception thrown: Volume tempest-invalid-203811151 could not be found. Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0bf52964-1fae-4985-a734-0f93992fc66f tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Request method failure captured: Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-203811151 HTTP/1.1 Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaEcyt6t2XdONE7rUqyqqw0ukgftI6Af0_lSVWb8F8COSQ6VCLlmT8clvUdh7285GI-1cfZ5aDPtstQxipUFQHWCoQ-Bvpgx0RYp9ILJfvWsGbmRhU8NZy1cQy4xHqOwLngc1-8BK-8mhJ6ERs8_nEpWGGQjrst7fOOGeblz6TA6nzE Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:12.863345 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9a7b9ab8ee46ada724d3759e710413", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 9b6acc2c539d465cbed6f92d1ca0aae5 Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Volume tempest-invalid-203811151 could not be found. Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'tempest-invalid-203811151'} Jul 12 16:28:12.864914 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-203811151 could not be found. (HTTP 404) (Request-ID: req-a7e0de09-c84f-46d7-b6bb-4246b0de7a51) Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.865812 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 16:28:12.867056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-203811151 could not be found. Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:12.868203 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-203811151 could not be found. Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-203811151 could not be found. Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0bf52964-1fae-4985-a734-0f93992fc66f tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Returning 404 to user: Volume tempest-invalid-203811151 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0bf52964-1fae-4985-a734-0f93992fc66f tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-203811151" status: 404 len: 98 microversion: 2.1 time: 0.035673 Jul 12 16:28:12.869447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 427/879] 10.222.0.20 () {58 vars in 1214 bytes} [Tue Jul 12 16:28:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-203811151 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 16:28:12.876523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-156180f3-e57f-4620-bfc9-2f8732e4b617 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003686 Jul 12 16:28:12.877070 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 453/880] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jul 12 16:28:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 16:28:12.885517 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1ea5d9b2-8bfb-4e4d-a782-8c46ccbf3731 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003530 Jul 12 16:28:12.885993 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 428/881] 10.222.0.20 () {58 vars in 1136 bytes} [Tue Jul 12 16:28:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 16:28:12.894527 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ce41a187-b0f7-451c-8579-13371eeac7c4 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Calling method '.version_select at 0x7f1da59afc10>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:12.921449 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-ce41a187-b0f7-451c-8579-13371eeac7c4 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] HTTP exception thrown: Volume 2a2beb98-af48-4f02-93a1-b18800b14f4f could not be found. Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ce41a187-b0f7-451c-8579-13371eeac7c4 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Request method failure captured: Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/os-volumes/2a2beb98-af48-4f02-93a1-b18800b14f4f HTTP/1.1 Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaEcyt6t2XdONE7rUqyqqw0ukgftI6Af0_lSVWb8F8COSQ6VCLlmT8clvUdh7285GI-1cfZ5aDPtstQxipUFQHWCoQ-Bvpgx0RYp9ILJfvWsGbmRhU8NZy1cQy4xHqOwLngc1-8BK-8mhJ6ERs8_nEpWGGQjrst7fOOGeblz6TA6nzE Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:12.923347 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9a7b9ab8ee46ada724d3759e710413", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 9b6acc2c539d465cbed6f92d1ca0aae5 Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Volume 2a2beb98-af48-4f02-93a1-b18800b14f4f could not be found. Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '2a2beb98-af48-4f02-93a1-b18800b14f4f'} Jul 12 16:28:12.924928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a2beb98-af48-4f02-93a1-b18800b14f4f could not be found. (HTTP 404) (Request-ID: req-98fe777a-07aa-4a6a-a0f1-290e9901c0ca) Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.925866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 16:28:12.927167 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a2beb98-af48-4f02-93a1-b18800b14f4f could not be found. Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 16:28:12.928478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a2beb98-af48-4f02-93a1-b18800b14f4f could not be found. Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a2beb98-af48-4f02-93a1-b18800b14f4f could not be found. Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ce41a187-b0f7-451c-8579-13371eeac7c4 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Returning 404 to user: Volume 2a2beb98-af48-4f02-93a1-b18800b14f4f could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ce41a187-b0f7-451c-8579-13371eeac7c4 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2a2beb98-af48-4f02-93a1-b18800b14f4f" status: 404 len: 109 microversion: 2.1 time: 0.034387 Jul 12 16:28:12.929911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 454/882] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:28:12 2022] DELETE /compute/v2.1/os-volumes/2a2beb98-af48-4f02-93a1-b18800b14f4f => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:28:12.934096 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0a073e48-3350-4623-ac17-b6e5006116c5 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Calling method '.version_select at 0x7f1da5807700>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:12.963235 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-0a073e48-3350-4623-ac17-b6e5006116c5 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] HTTP exception thrown: Volume ad9fb4b6-98f7-4abb-b448-e2a662709bec could not be found. Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0a073e48-3350-4623-ac17-b6e5006116c5 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Request method failure captured: Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/os-volumes/ad9fb4b6-98f7-4abb-b448-e2a662709bec HTTP/1.1 Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaEcyt6t2XdONE7rUqyqqw0ukgftI6Af0_lSVWb8F8COSQ6VCLlmT8clvUdh7285GI-1cfZ5aDPtstQxipUFQHWCoQ-Bvpgx0RYp9ILJfvWsGbmRhU8NZy1cQy4xHqOwLngc1-8BK-8mhJ6ERs8_nEpWGGQjrst7fOOGeblz6TA6nzE Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:12.965197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9a7b9ab8ee46ada724d3759e710413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9a7b9ab8ee46ada724d3759e710413", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 0e9a7b9ab8ee46ada724d3759e710413 Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesNegativeTest-1202781686 Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 9b6acc2c539d465cbed6f92d1ca0aae5 Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesNegativeTest-1202781686-project Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Volume ad9fb4b6-98f7-4abb-b448-e2a662709bec could not be found. Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'ad9fb4b6-98f7-4abb-b448-e2a662709bec'} Jul 12 16:28:12.966742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad9fb4b6-98f7-4abb-b448-e2a662709bec could not be found. (HTTP 404) (Request-ID: req-baad80df-7813-4354-9f2c-5dfae19b288a) Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.967686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 16:28:12.969200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad9fb4b6-98f7-4abb-b448-e2a662709bec could not be found. Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 16:28:12.970544 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad9fb4b6-98f7-4abb-b448-e2a662709bec could not be found. Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad9fb4b6-98f7-4abb-b448-e2a662709bec could not be found. Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0a073e48-3350-4623-ac17-b6e5006116c5 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] Returning 404 to user: Volume ad9fb4b6-98f7-4abb-b448-e2a662709bec could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0a073e48-3350-4623-ac17-b6e5006116c5 tempest-VolumesNegativeTest-1202781686 tempest-VolumesNegativeTest-1202781686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ad9fb4b6-98f7-4abb-b448-e2a662709bec" status: 404 len: 109 microversion: 2.1 time: 0.036312 Jul 12 16:28:12.971896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 429/883] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:28:12 2022] GET /compute/v2.1/os-volumes/ad9fb4b6-98f7-4abb-b448-e2a662709bec => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 16:28:13.767923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:13.769148 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:13.775671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:13.776121 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:13.776867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:13.777322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:13.922404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:13.930849 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f6a65c4f-a459-4cb2-ac41-7f9f5c549f7b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.167276 Jul 12 16:28:13.931402 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 455/884] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:13 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:14.948615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:14.949979 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:14.962285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:14.962818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:14.964228 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:14.964228 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:15.122764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:15.131613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-81cda082-b027-4c5b-aa93-3d25b42b8953 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.187820 Jul 12 16:28:15.132343 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 430/885] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:14 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:16.149008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:16.149639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:16.156146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:16.156587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:16.157361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:16.157792 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:16.301966 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:16.310630 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cc191efd-c542-474a-a9fa-8169afd29b6b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.165631 Jul 12 16:28:16.311296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 456/886] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:16 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:17.327739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:17.328353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:17.335125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:17.335603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:17.336363 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:17.336800 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:17.474910 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:17.482701 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3e9478e3-edd0-4333-a159-49f95f5d0acc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.158855 Jul 12 16:28:17.483266 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 431/887] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:17 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:18.500471 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:18.501105 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:18.508184 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:18.508635 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:18.509438 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:18.509878 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:18.651484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:18.659928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-172041b2-f11d-4fb9-82c3-3f924f792165 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.163393 Jul 12 16:28:18.660486 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 457/888] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:18 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:19.677070 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:19.677626 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:19.684080 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:19.684532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:19.685329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:19.685772 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:19.830559 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:19.838899 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6abc40e2-058d-4751-bb3f-c1eb5829b985 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.165896 Jul 12 16:28:19.839475 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 432/889] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:19 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:20.855614 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:20.856173 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:20.863083 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:20.863530 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:20.864289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:20.864750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:21.005287 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:21.013189 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-aab35497-ca40-4d8c-b38e-6a4e74b40308 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1757 microversion: 2.1 time: 0.161463 Jul 12 16:28:21.013746 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 458/890] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:20 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:22.030761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:22.031376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:22.034444 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:22.039646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:22.040112 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:22.040878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:22.041346 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:22.182064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:22.189951 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9663329f-c6b3-4305-be16-8b3c88b1a5ba tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1760 microversion: 2.1 time: 0.163122 Jul 12 16:28:22.190561 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 433/891] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:22 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:36.349794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9846011c-790f-4196-9e31-bcd40cf847a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:36.350809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9846011c-790f-4196-9e31-bcd40cf847a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:36.353400 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:36.354137 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=39 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:36.360040 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9846011c-790f-4196-9e31-bcd40cf847a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:36.360485 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9846011c-790f-4196-9e31-bcd40cf847a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:36.361266 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9846011c-790f-4196-9e31-bcd40cf847a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:36.361698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9846011c-790f-4196-9e31-bcd40cf847a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:36.389803 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9846011c-790f-4196-9e31-bcd40cf847a0 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044764 Jul 12 16:28:36.390349 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 459/892] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 16:28:36 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:28:36.446876 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:36.447361 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:36.449839 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:36.450477 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=54 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:36.456612 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:36.457110 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:36.457897 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:36.458327 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:36.484469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:28:36.708886 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ec8072e3-4b9f-49b0-919c-c14149549ecc tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 204 len: 0 microversion: 2.20 time: 0.265489 Jul 12 16:28:36.709757 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 434/893] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 16:28:36 2022] DELETE /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 16:28:36.717498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:36.718106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:36.724539 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:36.724984 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:36.725765 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:36.726205 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:36.850089 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:36.857819 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:36.859575 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:36.860702 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-46706b87-6ec4-451a-8e02-6a8e26b64152 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.147025 Jul 12 16:28:36.861277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 460/894] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:28:36 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:28:37.880748 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:37.881490 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:37.887939 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:37.888396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:37.889196 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:37.889650 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:38.019313 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:38.027198 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:38.028709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:38.029870 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-85048d87-57d2-4802-a955-15df97e68feb tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1722 microversion: 2.20 time: 0.154055 Jul 12 16:28:38.030415 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 435/895] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:28:37 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:28:39.011782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-60988bec-3374-4cf3-8c13-c8ff43219d77 req-d540440f-8244-4e43-a5c4-8728aecd4ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e", "name": "network-vif-deleted", "tag": "77b11a6f-6e1f-4b01-ab67-32247582df08"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:39.022042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-60988bec-3374-4cf3-8c13-c8ff43219d77 req-d540440f-8244-4e43-a5c4-8728aecd4ed5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:39.022478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-60988bec-3374-4cf3-8c13-c8ff43219d77 req-d540440f-8244-4e43-a5c4-8728aecd4ed5 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:39.033639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-60988bec-3374-4cf3-8c13-c8ff43219d77 req-d540440f-8244-4e43-a5c4-8728aecd4ed5 service nova] Creating event network-vif-deleted:77b11a6f-6e1f-4b01-ab67-32247582df08 for instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e on hv-cinder-79760 Jul 12 16:28:39.039328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-60988bec-3374-4cf3-8c13-c8ff43219d77 req-d540440f-8244-4e43-a5c4-8728aecd4ed5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031420 Jul 12 16:28:39.040020 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 461/896] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:39.047626 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:39.048237 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:39.054870 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:39.055314 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:39.056292 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:39.056892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:39.127653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:39.136968 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:39.139613 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e718e7f4f8974ff59151b87aef603a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ed8271e0d44de688f86520aa923c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:39.141106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ca4c0ba1-bf7e-4591-90e7-e69ae233471f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 200 len: 1366 microversion: 2.20 time: 0.097318 Jul 12 16:28:39.142157 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 436/897] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:28:39 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 16:28:40.161576 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:40.162460 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:40.169540 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:40.169998 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:40.170775 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:40.171216 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:40.184450 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] HTTP exception thrown: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Request method failure captured: Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e HTTP/1.1 Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kpBY8mfWm5SbswA_twWwWmKiY0c54kyPojGAMXXJLDy-wIIlnEB60qyWukF1Q4Ubq2EKu_wkRLawsgncGzPKSfr0FSo4OzhALGlHZUHveONVK9YGVLn8qeenCpfSWUSufu_8q6HmfAZRoGdi_zaTqnSgBbHNynC21vlgCR2zZ9io Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:40.186429 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77ed8271e0d44de688f86520aa923c60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: e718e7f4f8974ff59151b87aef603a09 Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:40.188495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e'} Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:40.189623 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:40.191200 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:40.193105 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Returning 404 to user: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:40.193105 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c89a56af-05cc-4777-8d0a-d79a36a4335f tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 404 len: 111 microversion: 2.20 time: 0.032130 Jul 12 16:28:40.193105 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 462/898] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:28:40 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:40.198245 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-01c16bdf-cfe2-4256-bef8-525f4e853495 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '.version_select at 0x7f1da59338b0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:40.216582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-01c16bdf-cfe2-4256-bef8-525f4e853495 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516095789" status: 204 len: 0 microversion: 2.20 time: 0.022618 Jul 12 16:28:40.217311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 437/899] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Jul 12 16:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516095789 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 16:28:42.095495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:42.096000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:42.102478 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:42.102931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:42.103714 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:42.104151 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:42.117565 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] HTTP exception thrown: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Request method failure captured: Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e HTTP/1.1 Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kpBY8mfWm5SbswA_twWwWmKiY0c54kyPojGAMXXJLDy-wIIlnEB60qyWukF1Q4Ubq2EKu_wkRLawsgncGzPKSfr0FSo4OzhALGlHZUHveONVK9YGVLn8qeenCpfSWUSufu_8q6HmfAZRoGdi_zaTqnSgBbHNynC21vlgCR2zZ9io Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:42.119142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77ed8271e0d44de688f86520aa923c60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: e718e7f4f8974ff59151b87aef603a09 Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.120873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e'} Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:42.121816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.123289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.124680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Returning 404 to user: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:42.124680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ee4b54de-52bc-48f7-abbe-ee08aa6b0335 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 404 len: 111 microversion: 2.20 time: 0.028915 Jul 12 16:28:42.124680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 463/900] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 16:28:42 2022] DELETE /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:42.129726 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:42.130290 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:42.137939 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:42.138384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:42.139142 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:42.139575 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:42.152857 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] HTTP exception thrown: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Request method failure captured: Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e HTTP/1.1 Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kpBY8mfWm5SbswA_twWwWmKiY0c54kyPojGAMXXJLDy-wIIlnEB60qyWukF1Q4Ubq2EKu_wkRLawsgncGzPKSfr0FSo4OzhALGlHZUHveONVK9YGVLn8qeenCpfSWUSufu_8q6HmfAZRoGdi_zaTqnSgBbHNynC21vlgCR2zZ9io Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:42.154521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77ed8271e0d44de688f86520aa923c60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: e718e7f4f8974ff59151b87aef603a09 Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.156171 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e'} Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:42.159997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. Jul 12 16:28:42.161665 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:42.163087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Returning 404 to user: Instance 4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:42.163087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5a151087-15bf-4e5a-8427-404963412584 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e" status: 404 len: 111 microversion: 2.20 time: 0.030812 Jul 12 16:28:42.163087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 438/901] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:28:42 2022] GET /compute/v2.1/servers/4f9bb6f2-a8d0-4b66-95a5-9c5af44aa19e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:43.296437 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:43.296936 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:43.303123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:43.303569 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:43.304362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:43.304825 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:43.321188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] HTTP exception thrown: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Request method failure captured: Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 HTTP/1.1 Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizZ-kpBY8mfWm5SbswA_twWwWmKiY0c54kyPojGAMXXJLDy-wIIlnEB60qyWukF1Q4Ubq2EKu_wkRLawsgncGzPKSfr0FSo4OzhALGlHZUHveONVK9YGVLn8qeenCpfSWUSufu_8q6HmfAZRoGdi_zaTqnSgBbHNynC21vlgCR2zZ9io Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:28:43.322958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77ed8271e0d44de688f86520aa923c60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: e718e7f4f8974ff59151b87aef603a09 Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.324654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'c6459fa8-bfbc-40a1-af27-2d44bad65d98'} Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:43.325528 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.326931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.328816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Returning 404 to user: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:43.328816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8535e52b-b079-4b29-aa07-d4dcd7e5067b tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 404 len: 111 microversion: 2.20 time: 0.031874 Jul 12 16:28:43.328816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 464/902] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 16:28:43 2022] DELETE /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:43.333508 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:43.334200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] [instance: c6459fa8-bfbc-40a1-af27-2d44bad65d98] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:43.340773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:43.341257 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:43.342082 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:43.342449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:43.356436 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] HTTP exception thrown: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Request method failure captured: Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 HTTP/1.1 Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizZ-kpBY8mfWm5SbswA_twWwWmKiY0c54kyPojGAMXXJLDy-wIIlnEB60qyWukF1Q4Ubq2EKu_wkRLawsgncGzPKSfr0FSo4OzhALGlHZUHveONVK9YGVLn8qeenCpfSWUSufu_8q6HmfAZRoGdi_zaTqnSgBbHNynC21vlgCR2zZ9io Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:28:43.358004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77ed8271e0d44de688f86520aa923c60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77ed8271e0d44de688f86520aa923c60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 77ed8271e0d44de688f86520aa923c60 Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360971309 Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: e718e7f4f8974ff59151b87aef603a09 Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360971309-project Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.360007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'c6459fa8-bfbc-40a1-af27-2d44bad65d98'} Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:28:43.361122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. Jul 12 16:28:43.362590 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:28:43.364114 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] Returning 404 to user: Instance c6459fa8-bfbc-40a1-af27-2d44bad65d98 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:28:43.364114 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9c556dd6-4523-469a-951c-12cdcd594d47 tempest-AttachVolumeShelveTestJSON-360971309 tempest-AttachVolumeShelveTestJSON-360971309-project] 10.222.0.20 "GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98" status: 404 len: 111 microversion: 2.20 time: 0.030632 Jul 12 16:28:43.364114 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 439/903] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 16:28:43 2022] GET /compute/v2.1/servers/c6459fa8-bfbc-40a1-af27-2d44bad65d98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 16:28:47.624139 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-2ed30b22-2cf3-43a5-91e0-c580b7cd4d02 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:47.624711 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-2ed30b22-2cf3-43a5-91e0-c580b7cd4d02 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:47.632101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2ed30b22-2cf3-43a5-91e0-c580b7cd4d02 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:47.632622 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2ed30b22-2cf3-43a5-91e0-c580b7cd4d02 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:47.633881 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2ed30b22-2cf3-43a5-91e0-c580b7cd4d02 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:47.634396 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-2ed30b22-2cf3-43a5-91e0-c580b7cd4d02 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:47.659633 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-2ed30b22-2cf3-43a5-91e0-c580b7cd4d02 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/ips" status: 200 len: 147 microversion: 2.1 time: 0.038884 Jul 12 16:28:47.664931 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 465/904] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:28:47 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:49.337209 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-45c5033d-5e2f-4fa7-911b-4a4e11de937f tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da594d280>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:49.384319 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-45c5033d-5e2f-4fa7-911b-4a4e11de937f tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/335962ac-34f5-4a95-94d9-a7e137490195" status: 200 len: 351 microversion: 2.1 time: 0.050887 Jul 12 16:28:49.384864 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 440/905] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:28:49 2022] GET /compute/v2.1/os-volumes/335962ac-34f5-4a95-94d9-a7e137490195 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:49.766923 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9ee343b0-53cd-4551-b9a1-48b4df7ba230 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "924bfdc1-119d-4c5b-a148-d551ca9dc2c1"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:49.767987 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9ee343b0-53cd-4551-b9a1-48b4df7ba230 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:49.774520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ee343b0-53cd-4551-b9a1-48b4df7ba230 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:49.774967 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ee343b0-53cd-4551-b9a1-48b4df7ba230 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:49.775728 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ee343b0-53cd-4551-b9a1-48b4df7ba230 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:49.776168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9ee343b0-53cd-4551-b9a1-48b4df7ba230 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:50.005269 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9ee343b0-53cd-4551-b9a1-48b4df7ba230 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242098 Jul 12 16:28:50.006138 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 466/906] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:28:49 2022] POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:50.693431 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d03e11a2-999a-4177-9661-c89ecb2d889f tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da592cb80>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:50.739795 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d03e11a2-999a-4177-9661-c89ecb2d889f tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5eda9153-a7d5-458e-867e-80be78cc0c1c" status: 200 len: 351 microversion: 2.1 time: 0.050637 Jul 12 16:28:50.740354 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 441/907] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:28:50 2022] GET /compute/v2.1/os-volumes/5eda9153-a7d5-458e-867e-80be78cc0c1c => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:28:52.050372 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-84c9104a-7ed7-47c2-b91d-7f1730d3d2f4 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da58755e0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.096009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-84c9104a-7ed7-47c2-b91d-7f1730d3d2f4 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/17f1833a-bf68-4ee5-852e-365f92e73362" status: 200 len: 351 microversion: 2.1 time: 0.049764 Jul 12 16:28:52.096690 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 467/908] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes/17f1833a-bf68-4ee5-852e-365f92e73362 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:52.109702 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ebe2d11a-4f70-42fb-b698-e131a4ddf9ec tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da592ca60>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.191582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ebe2d11a-4f70-42fb-b698-e131a4ddf9ec tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087099 Jul 12 16:28:52.192136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 442/909] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:52.204403 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-05f9c56f-0c9a-489c-bf91-9cadf7ac4937 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da59198b0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.282949 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-05f9c56f-0c9a-489c-bf91-9cadf7ac4937 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082697 Jul 12 16:28:52.283506 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 468/910] 10.222.0.20 () {58 vars in 1148 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:52.295596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d17eeac8-7ee0-4f55-a038-d0ad967cb8c2 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da57b44c0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.373749 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d17eeac8-7ee0-4f55-a038-d0ad967cb8c2 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081808 Jul 12 16:28:52.374315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 443/911] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:52.385672 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-18d4f70e-aeb3-4c00-9404-9168123c4296 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da58f93a0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.463930 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-18d4f70e-aeb3-4c00-9404-9168123c4296 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081918 Jul 12 16:28:52.464494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 469/912] 10.222.0.20 () {58 vars in 1166 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:52.477376 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4b076c00-3e2c-4fef-ad8e-bf21844291a9 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da581ac10>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.556044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4b076c00-3e2c-4fef-ad8e-bf21844291a9 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082327 Jul 12 16:28:52.556610 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 444/913] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:52.568847 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5945f076-adc2-4370-b66c-ac172747c170 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da59194c0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.649474 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5945f076-adc2-4370-b66c-ac172747c170 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084755 Jul 12 16:28:52.650093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 470/914] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:52.661291 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-144477d3-7542-4618-b65c-c645c3c83743 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1daa20e160>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.740746 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-144477d3-7542-4618-b65c-c645c3c83743 tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083236 Jul 12 16:28:52.741416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 445/915] 10.222.0.20 () {58 vars in 1187 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:28:52.752856 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3ce57677-9d1a-4e26-8a5b-f26b21ae57dc tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] Calling method '.version_select at 0x7f1da58eb4c0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:52.831106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3ce57677-9d1a-4e26-8a5b-f26b21ae57dc tempest-VolumesTestJSON-1360716241 tempest-VolumesTestJSON-1360716241-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.081914 Jul 12 16:28:52.831748 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 471/916] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jul 12 16:28:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:57.498703 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:57.499445 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:57.503904 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-393d1ff5-75cb-49cf-8e7d-7bef4fe07f00 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:28:57.511244 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-393d1ff5-75cb-49cf-8e7d-7bef4fe07f00 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:57.511719 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-393d1ff5-75cb-49cf-8e7d-7bef4fe07f00 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:57.574384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-393d1ff5-75cb-49cf-8e7d-7bef4fe07f00 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Going to try to stop instance {{(pid=117792) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 16:28:57.617569 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-393d1ff5-75cb-49cf-8e7d-7bef4fe07f00 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action" status: 202 len: 0 microversion: 2.1 time: 0.119844 Jul 12 16:28:57.618374 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 446/917] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:28:57 2022] POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:28:57.629197 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:57.630611 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:57.639112 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:57.639555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:57.640600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:57.641019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:57.782293 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:57.790918 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c8305134-af7f-49a5-8984-a6f052e087ad tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.167596 Jul 12 16:28:57.791494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 472/918] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:57 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:28:58.809961 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:58.810659 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:58.817455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:58.818323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:58.819099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:58.819534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:58.956885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:28:58.964786 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-07503608-01ea-4268-b383-a14d609e26af tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.159574 Jul 12 16:28:58.965380 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 447/919] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:58 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:28:59.981924 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:28:59.982523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:28:59.989188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:59.989634 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:28:59.990406 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:28:59.990836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:00.359682 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:00.368050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1a241041-0565-498b-b155-b6d1f906573c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.390052 Jul 12 16:29:00.368614 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 473/920] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:28:59 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:00.859691 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-348757957"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:00.861149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:00.868625 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:00.869324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:00.870159 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:00.870701 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:00.995904 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.network.security_group_api [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Removing security group 4aa39eb2-5b79-4a19-8248-d094a1d4d6fb from port 6f039bbe-a479-47f1-b01b-e2bdc0aa0973 Jul 12 16:29:01.324818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cc150ba7-bac3-4e49-aac7-21edeff2a1b4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/action" status: 202 len: 0 microversion: 2.1 time: 0.469613 Jul 12 16:29:01.333213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 448/921] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:29:00 2022] POST /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:29:01.335755 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-dc05465e-c40c-4bd0-80a6-0c05772ccdfb req-98775292-56cf-4372-b2eb-d609de540cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5517e0ab-0a63-452e-95b1-53dea9fec2f7", "tag": "6f039bbe-a479-47f1-b01b-e2bdc0aa0973"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:01.347725 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-dc05465e-c40c-4bd0-80a6-0c05772ccdfb req-98775292-56cf-4372-b2eb-d609de540cca service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:01.348771 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-dc05465e-c40c-4bd0-80a6-0c05772ccdfb req-98775292-56cf-4372-b2eb-d609de540cca service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:01.375320 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-dc05465e-c40c-4bd0-80a6-0c05772ccdfb req-98775292-56cf-4372-b2eb-d609de540cca service nova] Creating event network-changed:6f039bbe-a479-47f1-b01b-e2bdc0aa0973 for instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 on hv-cinder-79760 Jul 12 16:29:01.385238 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-dc05465e-c40c-4bd0-80a6-0c05772ccdfb req-98775292-56cf-4372-b2eb-d609de540cca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053444 Jul 12 16:29:01.386400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:01.386555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 474/922] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:29:01.387332 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:01.395170 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:01.395900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:01.397624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:01.398393 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:01.677596 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:01.686668 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8cd16ad8-bfd7-41ea-834b-2d57187fdef1 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.305007 Jul 12 16:29:01.688144 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 449/923] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:01 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:02.475660 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:02.476242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:02.477513 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-d887528a-3b8e-432c-a0f6-974d22cf3a26 req-5beccc41-ee18-46f1-b11e-82a5019ef262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5517e0ab-0a63-452e-95b1-53dea9fec2f7", "tag": "6f039bbe-a479-47f1-b01b-e2bdc0aa0973"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:02.483667 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:02.484115 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:02.484879 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:02.485514 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:02.486611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-d887528a-3b8e-432c-a0f6-974d22cf3a26 req-5beccc41-ee18-46f1-b11e-82a5019ef262 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:02.487727 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-d887528a-3b8e-432c-a0f6-974d22cf3a26 req-5beccc41-ee18-46f1-b11e-82a5019ef262 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:02.500483 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-d887528a-3b8e-432c-a0f6-974d22cf3a26 req-5beccc41-ee18-46f1-b11e-82a5019ef262 service nova] Creating event network-changed:6f039bbe-a479-47f1-b01b-e2bdc0aa0973 for instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 on hv-cinder-79760 Jul 12 16:29:02.506852 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-d887528a-3b8e-432c-a0f6-974d22cf3a26 req-5beccc41-ee18-46f1-b11e-82a5019ef262 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033220 Jul 12 16:29:02.507526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 450/924] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:29:02.583628 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lazy-loading 'services' on Instance uuid 5517e0ab-0a63-452e-95b1-53dea9fec2f7 {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:29:02.670469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e360bb9b-6705-4b57-97d3-d1c2cadbc76f tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments/15b8a1ca-1660-4af8-b5c1-3d3303dce4d9" status: 202 len: 0 microversion: 2.1 time: 0.198727 Jul 12 16:29:02.671252 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 475/925] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:29:02 2022] DELETE /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments/15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:29:02.681630 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6064d809-b8fa-43fe-8762-39cf438d49e4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:02.682919 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6064d809-b8fa-43fe-8762-39cf438d49e4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:02.697532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6064d809-b8fa-43fe-8762-39cf438d49e4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:02.698015 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6064d809-b8fa-43fe-8762-39cf438d49e4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:02.699213 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6064d809-b8fa-43fe-8762-39cf438d49e4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:02.699655 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6064d809-b8fa-43fe-8762-39cf438d49e4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:02.704612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:02.705336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:02.712125 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:02.712988 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:02.714495 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:02.715102 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:02.750742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6064d809-b8fa-43fe-8762-39cf438d49e4 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074080 Jul 12 16:29:02.751820 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 451/926] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:29:02 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:29:02.870757 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:02.878680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3045d9d1-2c6a-48b0-b523-5734b993d5fa tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.178379 Jul 12 16:29:02.879244 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 476/927] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:02 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:03.763615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bd1f6411-cd24-46a3-ad47-5aa6f8c7642b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:03.764560 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bd1f6411-cd24-46a3-ad47-5aa6f8c7642b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:03.771594 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd1f6411-cd24-46a3-ad47-5aa6f8c7642b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:03.772070 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd1f6411-cd24-46a3-ad47-5aa6f8c7642b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:03.772827 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd1f6411-cd24-46a3-ad47-5aa6f8c7642b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:03.773298 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd1f6411-cd24-46a3-ad47-5aa6f8c7642b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:03.800044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bd1f6411-cd24-46a3-ad47-5aa6f8c7642b tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040460 Jul 12 16:29:03.800588 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 452/928] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:29:03 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:29:03.810322 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:03.810866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:03.817662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:03.818101 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:03.818868 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:03.819296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:03.892085 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] HTTP exception thrown: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 is not attached to volume 15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 Jul 12 16:29:03.896004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:03.896615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Request method failure captured: Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments/15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 HTTP/1.1 Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaC-3xkdEhhNAlIDJ93LNlddnqrkLMHESVqGb-UNfCtTOax3nXZdWfnj2xYPBB7PnCUjNUJmLasjiHqsZMjT67j_HxoiSouhc9qn574ZyAsQJgCOip_awQMVLfiOFt-kqStCkRw2QZJstlz30ThtuSi_AtqdqueHJBSJDg49JL-F4bQ Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 33d90fe735cb45cc9040fe625e3da849 Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-TestMinimumBasicScenario-1116864276 Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:29:03.901377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33d90fe735cb45cc9040fe625e3da849"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/33d90fe735cb45cc9040fe625e3da849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33d90fe735cb45cc9040fe625e3da849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_33d90fe735cb45cc9040fe625e3da849", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-TestMinimumBasicScenario-1116864276 Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 33d90fe735cb45cc9040fe625e3da849 Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1116864276 Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-TestMinimumBasicScenario-1116864276-project Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 92c807f4f54b44839af98759312bd2bf Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-TestMinimumBasicScenario-1116864276-project Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:29:03.902835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 is not attached to volume 15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'server_id': '5517e0ab-0a63-452e-95b1-53dea9fec2f7', 'id': '15b8a1ca-1660-4af8-b5c1-3d3303dce4d9'} Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 15b8a1ca-1660-4af8-b5c1-3d3303dce4d9. Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:29:03.903555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 is not attached to volume 15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 is not attached to volume 15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:29:03.905651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Returning 404 to user: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 is not attached to volume 15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:29:03.907007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:03.907007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:03.907304 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-59afc704-7f3d-4a0f-bdd8-daa0cda38916 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments/15b8a1ca-1660-4af8-b5c1-3d3303dce4d9" status: 404 len: 154 microversion: 2.1 time: 0.096753 Jul 12 16:29:03.907455 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:03.907606 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 477/929] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:29:03 2022] DELETE /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7/os-volume_attachments/15b8a1ca-1660-4af8-b5c1-3d3303dce4d9 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:29:03.907752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:04.041442 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:04.049385 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-529050dc-19de-4399-a14b-13adf57cf73a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.157784 Jul 12 16:29:04.050471 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 453/930] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:03 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:05.042587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:05.043236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:05.049839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:05.050351 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:05.051117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:05.051617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:05.066389 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:05.067145 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:05.073817 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:05.074290 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:05.075063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:05.075543 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:05.078221 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:29:05.155473 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8bb7cee4-1bf3-4333-82ed-8f489f0dc2ef tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 204 len: 0 microversion: 2.1 time: 0.116376 Jul 12 16:29:05.156416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 478/931] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:29:05 2022] DELETE /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:29:05.164956 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:05.165808 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:05.172232 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:05.172681 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:05.173555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:05.173978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:05.207039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:05.215233 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-08caa2a5-5aad-4f5a-b136-322858e0cacb tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.152659 Jul 12 16:29:05.215809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 454/932] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:05 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:05.302774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:05.310155 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3ad6e4b1-1bb0-4b7d-9263-204a0344b67a tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1555 microversion: 2.1 time: 0.149629 Jul 12 16:29:05.310713 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 479/933] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:05 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:06.232493 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:06.233387 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:06.240760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:06.241261 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:06.242031 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:06.242543 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:06.327536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:06.328255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:06.335291 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:06.336183 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:06.337183 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:06.338619 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:06.361286 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:06.399005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:06.407335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-79eb7fe5-dd62-4d8e-8637-e0006713e7f0 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.179263 Jul 12 16:29:06.407913 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 455/934] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:06 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:06.482336 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:06.490112 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-9fccafbf-2eef-4167-ab79-005717854e37 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1555 microversion: 2.1 time: 0.166387 Jul 12 16:29:06.490668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 480/935] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:06 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:07.426751 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:07.427496 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:07.434728 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:07.435460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:07.436471 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:07.437526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:07.508698 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:07.509445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:07.512050 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:07.517306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:07.517935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:07.518757 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:07.519193 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:07.672735 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:07.703492 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7847944d-15ae-46e0-9dd4-bffe47f0b32e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.281224 Jul 12 16:29:07.704909 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 456/936] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:07 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:07.751829 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c807f4f54b44839af98759312bd2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d90fe735cb45cc9040fe625e3da849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:07.754775 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-fafb100c-42de-4043-bc0e-a16774d36751 req-6ec9c408-26a4-4e33-a456-bb5c73d31fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5517e0ab-0a63-452e-95b1-53dea9fec2f7", "name": "network-vif-deleted", "tag": "6f039bbe-a479-47f1-b01b-e2bdc0aa0973"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:07.762686 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e3b7f7d5-c880-4284-9419-a289b2ee43d7 tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 200 len: 1555 microversion: 2.1 time: 0.258006 Jul 12 16:29:07.763373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 481/937] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:07 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:07.774004 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fafb100c-42de-4043-bc0e-a16774d36751 req-6ec9c408-26a4-4e33-a456-bb5c73d31fd0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:07.774744 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fafb100c-42de-4043-bc0e-a16774d36751 req-6ec9c408-26a4-4e33-a456-bb5c73d31fd0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:07.787789 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-fafb100c-42de-4043-bc0e-a16774d36751 req-6ec9c408-26a4-4e33-a456-bb5c73d31fd0 service nova] Creating event network-vif-deleted:6f039bbe-a479-47f1-b01b-e2bdc0aa0973 for instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 on hv-cinder-79760 Jul 12 16:29:07.792902 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-fafb100c-42de-4043-bc0e-a16774d36751 req-6ec9c408-26a4-4e33-a456-bb5c73d31fd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042353 Jul 12 16:29:07.793531 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 457/938] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:29:08.721547 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:08.722163 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:08.728486 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:08.728932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:08.729724 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:08.730161 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:08.781065 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:08.781773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] [instance: 5517e0ab-0a63-452e-95b1-53dea9fec2f7] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:08.787872 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:08.788318 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:08.789094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:08.789534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:08.802953 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] HTTP exception thrown: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 could not be found. Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Request method failure captured: Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 HTTP/1.1 Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaC-3xkdEhhNAlIDJ93LNlddnqrkLMHESVqGb-UNfCtTOax3nXZdWfnj2xYPBB7PnCUjNUJmLasjiHqsZMjT67j_HxoiSouhc9qn574ZyAsQJgCOip_awQMVLfiOFt-kqStCkRw2QZJstlz30ThtuSi_AtqdqueHJBSJDg49JL-F4bQ Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 33d90fe735cb45cc9040fe625e3da849 Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestMinimumBasicScenario-1116864276 Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:29:08.804624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33d90fe735cb45cc9040fe625e3da849"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/33d90fe735cb45cc9040fe625e3da849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33d90fe735cb45cc9040fe625e3da849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_33d90fe735cb45cc9040fe625e3da849", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestMinimumBasicScenario-1116864276 Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 33d90fe735cb45cc9040fe625e3da849 Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1116864276 Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-TestMinimumBasicScenario-1116864276-project Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 92c807f4f54b44839af98759312bd2bf Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestMinimumBasicScenario-1116864276-project Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 could not be found. Jul 12 16:29:08.806260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '5517e0ab-0a63-452e-95b1-53dea9fec2f7'} Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 could not be found. Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:29:08.807094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 could not be found. Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 could not be found. Jul 12 16:29:08.809181 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:29:08.810511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Returning 404 to user: Instance 5517e0ab-0a63-452e-95b1-53dea9fec2f7 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:29:08.810511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c81bf75a-bb56-47e0-9bd9-8853517d10df tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7" status: 404 len: 111 microversion: 2.1 time: 0.029718 Jul 12 16:29:08.810511 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 458/939] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:08 2022] GET /compute/v2.1/servers/5517e0ab-0a63-452e-95b1-53dea9fec2f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 16:29:08.814169 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ce08cfbc-f190-4972-b659-4ff9e139a6cc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] Calling method '.version_select at 0x7f1da5933430>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:08.833311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ce08cfbc-f190-4972-b659-4ff9e139a6cc tempest-TestMinimumBasicScenario-1116864276 tempest-TestMinimumBasicScenario-1116864276-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-814321037" status: 202 len: 0 microversion: 2.1 time: 0.022546 Jul 12 16:29:08.834293 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 459/940] 10.222.0.20 () {58 vars in 1268 bytes} [Tue Jul 12 16:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-814321037 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 16:29:08.863685 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:08.871839 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e3b1d009-9680-45c5-b36f-b79060a893ab tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.154095 Jul 12 16:29:08.872401 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 482/941] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:08 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:09.889887 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:09.890458 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:09.897870 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:09.898322 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:09.899092 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:09.899534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:10.317751 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:10.327597 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-71d58073-5e0c-4ec1-9206-33d50b702f53 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.442119 Jul 12 16:29:10.328618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 460/942] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:09 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:11.345310 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:11.345911 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:11.352602 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:11.353074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:11.353866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:11.354367 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:11.650033 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:11.659817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8c7d6744-9b75-4da8-a560-01341b0357e3 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.318352 Jul 12 16:29:11.660396 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 483/943] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:11 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:12.677326 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:12.678933 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:12.687158 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:12.687614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:12.688392 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:12.688840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:12.915575 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:12.938064 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a5927648-7e1d-480d-b742-0d25310a8788 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1725 microversion: 2.1 time: 0.264949 Jul 12 16:29:12.940584 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 461/944] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:12 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:13.959512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:13.960153 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:13.966766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:13.967211 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:13.968174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:13.968740 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:14.175117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:14.184442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1440dd90-4d6b-408b-8ad3-43cba9377376 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1702 microversion: 2.1 time: 0.230941 Jul 12 16:29:14.187639 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 484/945] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:13 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1702 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:14.206245 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4735ee09-6e45-4d1d-82dc-a2b3f61443c2 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:14.225360 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4735ee09-6e45-4d1d-82dc-a2b3f61443c2 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:14.225682 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4735ee09-6e45-4d1d-82dc-a2b3f61443c2 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:14.250602 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4735ee09-6e45-4d1d-82dc-a2b3f61443c2 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Going to try to start instance {{(pid=117792) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 16:29:14.307998 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4735ee09-6e45-4d1d-82dc-a2b3f61443c2 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action" status: 202 len: 0 microversion: 2.1 time: 0.105535 Jul 12 16:29:14.309574 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 462/946] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:29:14 2022] POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:29:14.318486 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:14.319060 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:14.330328 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:14.331348 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:14.332128 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:14.332563 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:14.523362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:14.532312 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-65778cc0-3808-487c-baec-1b7f22f4b792 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1711 microversion: 2.1 time: 0.218544 Jul 12 16:29:14.533211 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 485/947] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:14 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1711 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:15.551860 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:15.552565 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:15.564130 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:15.564584 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:15.565970 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:15.566412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:15.803351 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:15.807110 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:15.816690 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5de9355e-9d14-4aa0-9e9f-7ff8511bb790 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1711 microversion: 2.1 time: 0.270108 Jul 12 16:29:15.817223 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 463/948] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:15 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1711 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:16.835597 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:16.836195 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:16.844106 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:16.844555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:16.845522 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:16.845962 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:17.019150 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:17.027257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-dba92c54-c617-4d84-9b9a-9674b9b8dde9 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1715 microversion: 2.1 time: 0.196876 Jul 12 16:29:17.027943 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 486/949] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:16 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1715 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:23.850482 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1165273437", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1223961137", "security_groups": [{"name": "tempest-secgroup-smoke-2089313887"}], "block_device_mapping_v2": [{"uuid": "857b12c4-bd64-4d86-9ae5-f49484fd6dff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e6199c1-7cb0-42ae-9742-827022684fbe"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:24.151001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] validate_networks() for [('0e6199c1-7cb0-42ae-9742-827022684fbe', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:29:25.149632 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:29:25.151866 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:29:25.152568 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:29:25.161532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:29:25.162368 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:29:25.177594 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:25.178253 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:25.179190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:25.182349 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:25.204898 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:29:25.209801 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Getting quotas for user a69aa7a2c98d4f30a5585c89e5295eb7 and project dca15cc5b53b4c51a9f7a6ce0f827ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:29:25.293366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:29:25.295247 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='857b12c4-bd64-4d86-9ae5-f49484fd6dff',volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:29:25.482271 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3517be00-622f-4bed-8a22-f400cae84572 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.636141 Jul 12 16:29:25.483552 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 464/950] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:29:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:29:25.494325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-caafeac8-4f47-43bb-af74-37b2ff08efd5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:25.495655 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-caafeac8-4f47-43bb-af74-37b2ff08efd5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:25.619424 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-caafeac8-4f47-43bb-af74-37b2ff08efd5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:25.640469 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-caafeac8-4f47-43bb-af74-37b2ff08efd5 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1095 microversion: 2.1 time: 0.150104 Jul 12 16:29:25.641376 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 487/951] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:25 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1095 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:26.659861 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:26.661340 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:26.673369 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:26.681042 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:26.682094 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:26.682686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:26.817341 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:26.827925 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b08d5b92-2af7-472a-83e3-42325302f0e3 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1193 microversion: 2.1 time: 0.173366 Jul 12 16:29:26.838469 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 465/952] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:26 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1193 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:27.845768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:27.846369 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:27.848646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=38 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:27.862303 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:27.863010 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:27.863946 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:27.864538 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:28.603810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:28.615188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-48a9ef4e-287b-4fdc-a1eb-746452180392 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1279 microversion: 2.1 time: 0.772563 Jul 12 16:29:28.622386 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 488/953] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:27 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1279 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:29.369240 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-4398026a-6323-4295-b26f-375985b61986 req-10c92dfb-851b-41df-8038-648afdfae421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb46700-8d74-49a9-a92e-f22563958da5", "tag": "aa975210-47f5-4df6-951a-8aa3b2c61b0d"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:29.384649 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:29.398750 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4398026a-6323-4295-b26f-375985b61986 req-10c92dfb-851b-41df-8038-648afdfae421 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:29.399565 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4398026a-6323-4295-b26f-375985b61986 req-10c92dfb-851b-41df-8038-648afdfae421 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:29.438189 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-4398026a-6323-4295-b26f-375985b61986 req-10c92dfb-851b-41df-8038-648afdfae421 service nova] Creating event network-changed:aa975210-47f5-4df6-951a-8aa3b2c61b0d for instance 1bb46700-8d74-49a9-a92e-f22563958da5 on hv-cinder-79760 Jul 12 16:29:29.456470 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-4398026a-6323-4295-b26f-375985b61986 req-10c92dfb-851b-41df-8038-648afdfae421 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093754 Jul 12 16:29:29.459722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 466/954] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:29:29.640064 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:29.641915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:29.670131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:29.670470 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:29.681731 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:29.682188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:29.934657 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:29.947896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f558e97f-c948-4b0f-8c08-14dbfbd13c13 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.319247 Jul 12 16:29:29.948552 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 489/955] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:29 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:30.012366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f177ab5c-1fde-460c-9664-64472c551be2 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Action: 'create', calling method: .version_select at 0x7f1da5933940>, body: {"keypair": {"name": "tempest-TestShelveInstance-112083651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfgy/yQEmMlK6e5fkKXRBU0twENeMcuY9nvSs6Jeu+kUvgH2wZd0NL0V+9/eX7uxhJwq1nQ3trB/HJ7cmkGYfGvCbJBvGT10jbcWmnfJ8LQE2wNWliRs2p9PW2Zs4dh6A=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:30.056353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-f177ab5c-1fde-460c-9664-64472c551be2 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Getting quotas for project 50404e382aca4cd0b0e0321a0e5294ea. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:29:30.070906 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-f177ab5c-1fde-460c-9664-64472c551be2 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Getting quotas for user df0360a875a74828874ef2a55f596be1 and project 50404e382aca4cd0b0e0321a0e5294ea. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:29:30.136649 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f177ab5c-1fde-460c-9664-64472c551be2 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.463205 Jul 12 16:29:30.137357 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 467/956] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:29:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:29:30.967288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:30.967953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:30.974668 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:30.975120 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:30.976109 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:30.976553 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:31.130647 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:31.138447 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-476436a4-27ef-4fc7-9e92-7d0c64fcdea7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.175590 Jul 12 16:29:31.139093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 490/957] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:30 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:32.157647 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:32.162248 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:32.175551 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:32.176731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:32.178956 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:32.179979 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:32.420678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:32.431826 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e3428f0e-d787-4628-a472-d6a4c7907ace tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.278601 Jul 12 16:29:32.432476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 468/958] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:32 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:33.449616 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:33.450869 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:33.457792 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:33.458325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:33.459178 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:33.459671 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:33.597962 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:33.605587 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a65382f9-1531-4cb1-b6fa-9d9730ec9743 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.159836 Jul 12 16:29:33.606169 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 491/959] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:33 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:34.623546 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:34.624156 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:34.631172 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:34.631616 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:34.632400 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:34.632835 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:34.771828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:34.779236 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-392ad30d-a589-4305-94b3-fa188414b33c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.159743 Jul 12 16:29:34.779794 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 469/960] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:34 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:29:35.796024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:35.796641 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:35.799053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:35.804832 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:35.805198 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:35.806000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:35.806435 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:35.943155 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:35.950977 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ef99e22d-7961-4071-b125-c4175f2619c9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.158917 Jul 12 16:29:35.951654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 492/961] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:35 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:36.970057 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:36.970660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:36.973302 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:36.979286 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:36.979730 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:36.980490 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:36.980918 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:37.111611 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:37.119002 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4635947b-8d4e-47b4-9c2a-33b6e742f71e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.152807 Jul 12 16:29:37.119558 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 470/962] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:36 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:38.136143 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:38.137024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:38.139343 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=26 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:38.144700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:38.145273 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:38.146976 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:38.147416 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:38.287954 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:38.295484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-66e7209f-5561-4a46-bd5a-5305b27c2a7b tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.163296 Jul 12 16:29:38.296040 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 493/963] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:38 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:39.313201 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:39.313748 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:39.320976 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:39.321451 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:39.322214 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:39.322654 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:39.458536 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:39.465831 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2423bf64-cb50-4ba1-ad1e-8ac0f569e9ed tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.156824 Jul 12 16:29:39.466384 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 471/964] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:39 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:40.482797 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:40.483927 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:40.491141 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:40.491579 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:40.492334 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:40.492765 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:40.634252 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:40.643774 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-49dd53f2-089a-4567-a9a2-73ecc15efec1 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.164343 Jul 12 16:29:40.644346 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 494/965] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:40 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:41.607858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-43a21ebd-f032-4980-aa30-edd99975fe10 req-ac6510f6-2a60-4487-bc80-44223bd093ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb46700-8d74-49a9-a92e-f22563958da5", "name": "network-vif-plugged", "status": "completed", "tag": "aa975210-47f5-4df6-951a-8aa3b2c61b0d"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:41.611423 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=10 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:41.619506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-43a21ebd-f032-4980-aa30-edd99975fe10 req-ac6510f6-2a60-4487-bc80-44223bd093ac service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:41.619974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-43a21ebd-f032-4980-aa30-edd99975fe10 req-ac6510f6-2a60-4487-bc80-44223bd093ac service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:41.633428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-43a21ebd-f032-4980-aa30-edd99975fe10 req-ac6510f6-2a60-4487-bc80-44223bd093ac service nova] Creating event network-vif-plugged:aa975210-47f5-4df6-951a-8aa3b2c61b0d for instance 1bb46700-8d74-49a9-a92e-f22563958da5 on hv-cinder-79760 Jul 12 16:29:41.639762 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-43a21ebd-f032-4980-aa30-edd99975fe10 req-ac6510f6-2a60-4487-bc80-44223bd093ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036330 Jul 12 16:29:41.640249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 472/966] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:29:41.660866 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:41.661505 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:41.669491 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:41.670196 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:41.670963 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:41.671555 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:41.811107 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:41.819511 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3e636518-0329-4fda-9cb0-41476395ce1d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.163206 Jul 12 16:29:41.820152 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 495/967] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:41 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:42.836766 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:42.837632 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:42.843915 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:42.844361 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:42.845146 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:42.845582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:42.984059 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:42.991735 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a64fe630-8516-4142-8a5e-9509fb3ac04d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1267 microversion: 2.1 time: 0.159830 Jul 12 16:29:42.992361 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 473/968] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:42 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:44.009074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:44.009700 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:44.015844 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:44.016285 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:44.017030 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:44.017484 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:44.149174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:44.156680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-120f6caa-d220-45e9-a348-9aa0e72d1adb tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1454 microversion: 2.1 time: 0.151407 Jul 12 16:29:44.157284 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 496/969] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:44 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:44.172941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:44.173573 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:44.180277 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:44.180724 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:44.181501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:44.181939 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:44.311976 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:44.319546 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7f7f1159-2aa0-4164-9ab8-8b48b41dc1a0 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1454 microversion: 2.1 time: 0.150380 Jul 12 16:29:44.320311 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 474/970] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:44 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:46.056790 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-10a4dbbf-5df5-4c04-9a31-76ddd8e32fbd req-a1045be2-1fea-408d-b486-8f7c24a72744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb46700-8d74-49a9-a92e-f22563958da5", "tag": "aa975210-47f5-4df6-951a-8aa3b2c61b0d"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:46.065867 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-10a4dbbf-5df5-4c04-9a31-76ddd8e32fbd req-a1045be2-1fea-408d-b486-8f7c24a72744 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:46.066313 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-10a4dbbf-5df5-4c04-9a31-76ddd8e32fbd req-a1045be2-1fea-408d-b486-8f7c24a72744 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:46.077764 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-10a4dbbf-5df5-4c04-9a31-76ddd8e32fbd req-a1045be2-1fea-408d-b486-8f7c24a72744 service nova] Creating event network-changed:aa975210-47f5-4df6-951a-8aa3b2c61b0d for instance 1bb46700-8d74-49a9-a92e-f22563958da5 on hv-cinder-79760 Jul 12 16:29:46.083316 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-10a4dbbf-5df5-4c04-9a31-76ddd8e32fbd req-a1045be2-1fea-408d-b486-8f7c24a72744 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030202 Jul 12 16:29:46.083951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 497/971] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:29:52.061483 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-93425195", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-112083651", "security_groups": [{"name": "tempest-secgroup-smoke-842789551"}], "networks": [{"uuid": "fcfc8b68-a10e-444b-b633-dd2a06648d46"}], "block_device_mapping_v2": [{"uuid": "bbc60de2-289a-440c-ae2f-0c379d08eecd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:52.214978 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] validate_networks() for [('fcfc8b68-a10e-444b-b633-dd2a06648d46', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:29:52.840416 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:29:52.840837 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:29:52.841337 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:29:52.841741 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:29:52.842531 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:29:52.853559 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:52.854011 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:52.855090 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:52.855524 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:52.872534 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Getting quotas for project 50404e382aca4cd0b0e0321a0e5294ea. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:29:52.876450 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Getting quotas for user df0360a875a74828874ef2a55f596be1 and project 50404e382aca4cd0b0e0321a0e5294ea. Resources: {'cores', 'instances', 'ram'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:29:52.933900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:29:52.936113 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbc60de2-289a-440c-ae2f-0c379d08eecd',volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:29:53.068091 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3a0bda16-e304-4364-a788-2bea8535b517 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.010516 Jul 12 16:29:53.073430 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 475/972] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:29:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:29:53.079100 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1702c500-88f6-454c-a929-2d924b10db75 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:53.079798 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1702c500-88f6-454c-a929-2d924b10db75 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:53.139808 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-1702c500-88f6-454c-a929-2d924b10db75 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:53.147402 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1702c500-88f6-454c-a929-2d924b10db75 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1086 microversion: 2.1 time: 0.072270 Jul 12 16:29:53.148236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 498/973] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:53 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1086 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:54.164787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:54.165443 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:54.172180 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:54.172638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:54.173437 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:54.173875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:54.177248 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=51 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:54.238356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:54.246283 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6f4497e9-ed0c-43ca-8bd1-26565addf725 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1184 microversion: 2.1 time: 0.085899 Jul 12 16:29:54.246958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 476/974] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:54 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1184 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:55.263854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:55.264574 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:55.272610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:55.273422 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:55.274288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:55.274779 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:55.419515 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:55.428734 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d6b6572c-3bf3-4964-8ecd-b86890d07b9c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.168953 Jul 12 16:29:55.429584 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 499/975] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:55 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:55.919930 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-5aad3d14-fcd0-49d9-a7a4-aef03bbafcdc req-190335e5-111b-4f38-bc7e-5e865ccabce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420d5478-b9a8-440a-a872-e1f3f94f0fb0", "tag": "7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:29:55.947562 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5aad3d14-fcd0-49d9-a7a4-aef03bbafcdc req-190335e5-111b-4f38-bc7e-5e865ccabce1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:55.948022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5aad3d14-fcd0-49d9-a7a4-aef03bbafcdc req-190335e5-111b-4f38-bc7e-5e865ccabce1 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:55.960353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-5aad3d14-fcd0-49d9-a7a4-aef03bbafcdc req-190335e5-111b-4f38-bc7e-5e865ccabce1 service nova] Creating event network-changed:7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc for instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 on hv-cinder-79760 Jul 12 16:29:55.968190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-5aad3d14-fcd0-49d9-a7a4-aef03bbafcdc req-190335e5-111b-4f38-bc7e-5e865ccabce1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052313 Jul 12 16:29:55.968970 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 477/976] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:29:56.447690 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:56.448282 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:56.454937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:56.455277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:56.456042 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:56.456987 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:56.593782 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:56.602440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-28f0cc28-ed23-4370-912a-3de87ba3cd82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.158561 Jul 12 16:29:56.603018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 500/977] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:56 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:57.620689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:57.621482 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:57.627729 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:57.628202 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:57.628963 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:57.629457 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:57.766790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:57.774522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1ce0018d-db82-451d-8add-5a69924bbad9 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.158477 Jul 12 16:29:57.775106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 478/978] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:57 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:58.791593 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:58.792199 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:58.798577 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:58.799025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:58.800412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:58.800718 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:58.803407 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=69 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:58.942841 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:29:58.950558 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-146da80b-c37a-4162-bb47-2bccc03bdaf8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.162758 Jul 12 16:29:58.951135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 501/979] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:58 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:29:59.967441 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:29:59.968005 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:29:59.970418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:59.976125 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:59.976572 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:29:59.977356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:29:59.977793 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:00.113471 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:00.121428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d73ba556-ee2c-4e8d-8e09-4452647bc63d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.157852 Jul 12 16:30:00.122003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 479/980] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:29:59 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:01.138506 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:01.139131 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:01.146345 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:01.146794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:01.147571 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:01.148005 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:01.278809 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:01.287057 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7ac3b18a-5463-4519-91ce-446e095e088f tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.152621 Jul 12 16:30:01.287634 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 502/981] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:01 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:02.303952 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:02.304510 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:02.311073 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:02.311523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:02.312293 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:02.312734 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:02.444638 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:02.452325 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e0644741-8dd7-4e20-a83e-af1704022b1a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.152491 Jul 12 16:30:02.452890 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 480/982] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:02 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:03.469062 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:03.469706 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:03.471981 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:03.477926 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:03.478376 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:03.479146 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:03.479584 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:03.613611 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:03.621107 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d1ad0e2a-9e40-4367-ae17-e6a8f2d0c6d8 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.155969 Jul 12 16:30:03.621667 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 503/983] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:03 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:04.638153 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:04.638684 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:04.640510 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:04.641184 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:04.647809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:04.648258 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:04.649020 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:04.649484 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:04.780288 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:04.789375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8ce88d85-4822-4955-b1a7-7cd155cc48ef tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.155156 Jul 12 16:30:04.789944 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 481/984] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:04 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:05.156440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:05.157018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:05.163452 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:05.163896 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:05.164651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:05.165109 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:05.246122 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lazy-loading 'services' on Instance uuid 854f546f-6c0c-4db8-bc32-286169fe686b {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:30:05.315374 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-decfbe99-bc0e-4b8f-8c3a-cee38f4329ce tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-volume_attachments/924bfdc1-119d-4c5b-a148-d551ca9dc2c1" status: 202 len: 0 microversion: 2.1 time: 0.162775 Jul 12 16:30:05.315958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 504/985] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:30:05 2022] DELETE /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-volume_attachments/924bfdc1-119d-4c5b-a148-d551ca9dc2c1 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:30:05.805976 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:05.806604 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:05.814099 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:05.814560 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:05.815329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:05.815773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:05.946233 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:05.953622 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a4a15644-58ec-4385-9c37-88bdac1eec44 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.152383 Jul 12 16:30:05.954190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 482/986] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:05 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:06.430243 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-05c303a9-6cd2-4643-a666-809b25c3f6a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:30:06.436443 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-05c303a9-6cd2-4643-a666-809b25c3f6a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:06.436890 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-05c303a9-6cd2-4643-a666-809b25c3f6a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:06.495112 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-05c303a9-6cd2-4643-a666-809b25c3f6a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Going to try to stop instance {{(pid=117791) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 16:30:06.537361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-05c303a9-6cd2-4643-a666-809b25c3f6a8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action" status: 202 len: 0 microversion: 2.1 time: 0.111617 Jul 12 16:30:06.537938 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 505/987] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:30:06 2022] POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:30:06.546105 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:06.546713 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:06.552707 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:06.553226 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:06.554008 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:06.554365 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:06.684121 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:06.691474 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-01563897-97ba-4540-b749-ef6823004402 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.149229 Jul 12 16:30:06.692031 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 483/988] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:06 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:06.970373 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:06.971062 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:06.977134 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:06.977580 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:06.978357 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:06.978781 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:07.106817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:07.115180 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-df70b17c-a3b3-419a-9722-00a698ebff82 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.148520 Jul 12 16:30:07.115747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 506/989] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:06 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:07.709581 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:07.710239 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:07.716674 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:07.717150 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:07.717438 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-e126e8a4-d0d7-4a3f-8d68-26c8dbfe25d8 req-25b9250a-4c4d-4542-88d4-452d7d759e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420d5478-b9a8-440a-a872-e1f3f94f0fb0", "name": "network-vif-plugged", "status": "completed", "tag": "7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:30:07.717911 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:07.718344 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:07.727789 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-e126e8a4-d0d7-4a3f-8d68-26c8dbfe25d8 req-25b9250a-4c4d-4542-88d4-452d7d759e7b service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:07.728586 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-e126e8a4-d0d7-4a3f-8d68-26c8dbfe25d8 req-25b9250a-4c4d-4542-88d4-452d7d759e7b service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:07.743134 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-e126e8a4-d0d7-4a3f-8d68-26c8dbfe25d8 req-25b9250a-4c4d-4542-88d4-452d7d759e7b service nova] Creating event network-vif-plugged:7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc for instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 on hv-cinder-79760 Jul 12 16:30:07.748520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-e126e8a4-d0d7-4a3f-8d68-26c8dbfe25d8 req-25b9250a-4c4d-4542-88d4-452d7d759e7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035372 Jul 12 16:30:07.749716 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 507/990] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:30:07.869592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:07.878486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3e7f8812-206d-4e48-9ad4-56b31f907f2a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.172990 Jul 12 16:30:07.879058 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 484/991] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:07 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:08.132256 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:08.132961 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:08.141283 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:08.141605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:08.142381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:08.142817 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:08.280854 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:08.288843 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cc06c74e-58cd-4217-b1e5-4ea90275ac78 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.160867 Jul 12 16:30:08.289447 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 508/992] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:08 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:08.897627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:08.898240 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:08.904748 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:08.905246 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:08.906002 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:08.906440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:09.035312 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:09.042906 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1b9948cc-0391-4417-aafe-2aee46eaa5dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.149782 Jul 12 16:30:09.043476 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 485/993] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:08 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:09.306009 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:09.306420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:09.308815 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=34 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:09.314179 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:09.315230 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:09.317025 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:09.317843 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:09.456236 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:09.464140 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-03a1c9c7-f445-4e0c-be5c-b17d53a4bc1b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1257 microversion: 2.1 time: 0.162767 Jul 12 16:30:09.464709 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 509/994] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:09 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:10.060614 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:10.061265 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:10.068375 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:10.068822 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:10.069619 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:10.070056 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:10.195712 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:10.203092 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-db32564a-4ecb-49a1-9207-eaa7cf719193 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.146403 Jul 12 16:30:10.203655 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 486/995] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:10 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:10.480142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:10.480754 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:10.487412 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:10.487892 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:10.488610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:10.489069 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:10.625806 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:10.634930 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-f58d1f36-8a5b-4653-a6ba-f44cae788f13 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1441 microversion: 2.1 time: 0.158587 Jul 12 16:30:10.635834 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 510/996] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:10 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1441 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:10.651615 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:10.652216 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:10.658369 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:10.659014 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:10.659988 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:10.660782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:10.800326 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:10.808414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2fc8975c-4c92-4e0a-9516-d4419943f81d tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1441 microversion: 2.1 time: 0.160558 Jul 12 16:30:10.809025 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 487/997] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:10 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1441 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:11.219715 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:11.220418 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:11.226939 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:11.227382 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:11.228142 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:11.228575 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:11.356248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:11.364592 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8ce8b96b-87ad-4322-bd8e-2fb7df869c74 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.148279 Jul 12 16:30:11.365270 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 511/998] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:11 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:12.381740 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:12.382503 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:12.388997 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:12.389547 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:12.390432 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:12.390900 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:12.828238 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:12.837694 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0e234073-d793-49a1-ba8f-40cc80c546cf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.459788 Jul 12 16:30:12.838683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 488/999] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:12 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:12.843165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-bb3b3362-d205-4616-8531-4e6ea55fdc2c req-ff19291c-3d11-4dc5-b456-a688cd312ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420d5478-b9a8-440a-a872-e1f3f94f0fb0", "tag": "7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:30:12.853388 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-bb3b3362-d205-4616-8531-4e6ea55fdc2c req-ff19291c-3d11-4dc5-b456-a688cd312ef0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:12.853829 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-bb3b3362-d205-4616-8531-4e6ea55fdc2c req-ff19291c-3d11-4dc5-b456-a688cd312ef0 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:12.865502 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-bb3b3362-d205-4616-8531-4e6ea55fdc2c req-ff19291c-3d11-4dc5-b456-a688cd312ef0 service nova] Creating event network-changed:7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc for instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 on hv-cinder-79760 Jul 12 16:30:12.870383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-bb3b3362-d205-4616-8531-4e6ea55fdc2c req-ff19291c-3d11-4dc5-b456-a688cd312ef0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032101 Jul 12 16:30:12.871002 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 512/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:30:13.855449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:13.856003 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:13.862175 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:13.862620 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:13.863372 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:13.863801 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:13.997477 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:14.005950 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-71ba3e36-9d1a-4ae6-ba0f-b58c922abfb7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.154593 Jul 12 16:30:14.006523 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 489/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:13 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:15.023235 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:15.023937 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:15.030239 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:15.030702 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:15.031460 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:15.031914 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:15.161638 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:15.169080 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ab90c6fc-69c8-44eb-b658-63562b015634 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.150718 Jul 12 16:30:15.169640 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 513/1002] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:15 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:16.188940 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:16.189618 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:16.196990 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:16.197643 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:16.198462 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:16.198822 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:16.333022 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:16.340609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2f9b0940-5698-4d74-b993-7e0ea62908df tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.156352 Jul 12 16:30:16.341191 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 490/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:16 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:30:17.358621 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:17.359927 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:17.367244 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:17.367692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:17.368446 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:17.369071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:17.506823 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:17.514471 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-35654ee2-78b3-4a50-ba3d-57fee75db279 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.159850 Jul 12 16:30:17.515059 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 514/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:17 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:18.537113 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:18.538350 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:18.547049 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:18.547751 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:18.548537 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:18.548980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:18.681948 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:18.689739 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-72bac866-de7c-4c86-a8b6-b593670f612c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.162090 Jul 12 16:30:18.690307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 491/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:18 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:19.707439 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:19.708745 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:19.715289 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:19.715740 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:19.716496 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:19.716935 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:19.848093 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:19.856260 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-35cea860-1dbb-44f8-acbb-b155280a6095 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.152763 Jul 12 16:30:19.865863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 515/1006] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:19 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:20.873226 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:20.873943 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:20.880273 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:20.880717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:20.881514 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:20.881941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:21.013037 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:21.020838 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ccf5127e-200d-41b7-9708-6683db033ef6 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1679 microversion: 2.1 time: 0.151372 Jul 12 16:30:21.021603 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 492/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:20 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:22.038032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:22.038742 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:22.045204 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:22.045649 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:22.046404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:22.046833 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:22.180277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:22.187632 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-22b14188-158b-42e3-83b4-504a2687412a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1656 microversion: 2.1 time: 0.153459 Jul 12 16:30:22.188187 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 516/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:22 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:22.204124 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6cf7223f-cb78-4fdf-b5b2-4973e8d95eef tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:30:22.210655 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf7223f-cb78-4fdf-b5b2-4973e8d95eef tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:22.211112 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf7223f-cb78-4fdf-b5b2-4973e8d95eef tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:22.224315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:22.234653 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6cf7223f-cb78-4fdf-b5b2-4973e8d95eef tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Going to try to start instance {{(pid=117792) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 16:30:22.276782 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6cf7223f-cb78-4fdf-b5b2-4973e8d95eef tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action" status: 202 len: 0 microversion: 2.1 time: 0.076327 Jul 12 16:30:22.277407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 493/1009] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:30:22 2022] POST /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 16:30:22.285441 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:22.286054 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:22.292457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:22.293006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:22.293895 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:22.294377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:22.456978 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:22.573263 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:22.580972 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-65602700-5ee3-417d-90ae-e3be30ed5d63 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1665 microversion: 2.1 time: 0.299373 Jul 12 16:30:22.581564 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 517/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:22 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1665 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:30:23.197952 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:30:23.198584 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Tue Jul 12 16:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:30:23.599858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:30:23.600475 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:30:23.606627 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:23.607329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:23.608111 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:30:23.608542 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:30:23.737651 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:30:23.746063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-290d8947-6e1b-4d6c-a57d-564c2a71cb48 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1669 microversion: 2.1 time: 0.150945 Jul 12 16:30:23.747076 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 494/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:30:23 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:02.071377 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b0a50545-92e1-4df7-8c0e-d4cd76232481 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:02.072456 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b0a50545-92e1-4df7-8c0e-d4cd76232481 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:02.074485 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=17 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.075117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.081196 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0a50545-92e1-4df7-8c0e-d4cd76232481 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:02.081640 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0a50545-92e1-4df7-8c0e-d4cd76232481 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:02.082396 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0a50545-92e1-4df7-8c0e-d4cd76232481 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:02.082822 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b0a50545-92e1-4df7-8c0e-d4cd76232481 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:02.111290 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b0a50545-92e1-4df7-8c0e-d4cd76232481 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044298 Jul 12 16:31:02.112005 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 518/1012] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:31:02 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:31:02.167331 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:02.167836 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:02.169955 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=31 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.170606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.176114 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:02.176564 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:02.177368 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:02.177807 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:02.205548 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:31:02.276809 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a712eb99-979e-440c-b7b0-26137e00daa4 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 204 len: 0 microversion: 2.1 time: 0.113191 Jul 12 16:31:02.277426 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 495/1013] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:31:02 2022] DELETE /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:31:02.286300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:02.287135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:02.293780 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:02.294231 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:02.294988 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:02.295424 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:02.423772 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:02.431582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b31ad38d-7ed6-4a7e-b1af-97932b07306c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1675 microversion: 2.1 time: 0.149665 Jul 12 16:31:02.432129 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 519/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:02 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:03.449216 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:03.449920 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:03.456521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:03.456973 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:03.457769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:03.458207 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:03.589272 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:03.596639 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a7892c28-ae27-45c2-8c5a-de948c5db2e8 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1675 microversion: 2.1 time: 0.152241 Jul 12 16:31:03.597241 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 496/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:03 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:04.613626 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:04.614242 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:04.621283 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:04.621730 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:04.622488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:04.622921 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:04.749185 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:04.756665 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-cac57910-0053-4ba7-839e-20881d68c2ff tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1675 microversion: 2.1 time: 0.146961 Jul 12 16:31:04.757257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 520/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:04 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:05.393742 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-bc561faa-83e6-47e5-9c67-eac403688857 req-7b4ba35c-5cf3-4d95-ab7c-aaa45c094d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854f546f-6c0c-4db8-bc32-286169fe686b", "name": "network-vif-deleted", "tag": "4f70e2bf-0cb8-4109-8ed2-f0b8046999dc"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:05.402412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-bc561faa-83e6-47e5-9c67-eac403688857 req-7b4ba35c-5cf3-4d95-ab7c-aaa45c094d42 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:05.402853 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-bc561faa-83e6-47e5-9c67-eac403688857 req-7b4ba35c-5cf3-4d95-ab7c-aaa45c094d42 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:05.414200 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-bc561faa-83e6-47e5-9c67-eac403688857 req-7b4ba35c-5cf3-4d95-ab7c-aaa45c094d42 service nova] Creating event network-vif-deleted:4f70e2bf-0cb8-4109-8ed2-f0b8046999dc for instance 854f546f-6c0c-4db8-bc32-286169fe686b on hv-cinder-79760 Jul 12 16:31:05.419564 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-bc561faa-83e6-47e5-9c67-eac403688857 req-7b4ba35c-5cf3-4d95-ab7c-aaa45c094d42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029940 Jul 12 16:31:05.420219 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 497/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:05.774457 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:05.775018 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:05.781330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:05.781789 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:05.782551 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:05.782987 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:05.815644 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:05.816255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:05.816707 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lazy-loading 'fault' on Instance uuid 854f546f-6c0c-4db8-bc32-286169fe686b {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:31:05.870032 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:05.877679 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8a39b446-f856-4daa-a33f-b269cde2f557 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 200 len: 1328 microversion: 2.1 time: 0.107138 Jul 12 16:31:05.878356 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 521/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:05 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:06.895894 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:06.896586 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:06.902827 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:06.903258 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:06.904010 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:06.904441 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:06.917190 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] HTTP exception thrown: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Request method failure captured: Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b HTTP/1.1 Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaEE9gjD6oXJVdwTjDABxaYTFe-RzyDkshIe-S50rXHfU4JCDqlKXze0hkpEuSmLsVy2OlLdvwPmsLTHSSEmUjQL5dKwJTWVXdAAoLqHOGUvT_3xG1AQESEq_PLnYG09j30CYh1fg66v8MOrMyDYQUKeF0M9soXUznhJxNUhQi45ARg Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:31:06.918769 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_356781184b3e4b409522e2a81d701fb5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 0fd410fff845482ab3f04c7ccacf0d0a Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:31:06.920249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '854f546f-6c0c-4db8-bc32-286169fe686b'} Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:31:06.921120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:31:06.922709 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:06.924205 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Returning 404 to user: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:31:06.924205 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c227e68a-7606-451b-b10c-84e1e5b12e04 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 404 len: 111 microversion: 2.1 time: 0.028905 Jul 12 16:31:06.924205 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 498/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:06 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:06.928901 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-40173e4c-dc1e-40fd-8c97-fff2f29f564d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '.version_select at 0x7f1da57b9430>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:06.946646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-40173e4c-dc1e-40fd-8c97-fff2f29f564d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938184238" status: 202 len: 0 microversion: 2.1 time: 0.020940 Jul 12 16:31:06.947191 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 522/1020] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 16:31:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938184238 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:31:07.554597 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fd1b5814-c519-48e4-9080-2f725284140b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'create', calling method: .version_select at 0x7f1da6361f70>, body: {"keypair": {"name": "tempest-keypair-838742366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI1knVSmBnqB/fC/PtskT2aTRbmGHXJjZwZ7SpMFPjdYqolgwJ8Fi1qaJo6ZUwHC2g9mnfDeB0lCO71oNwpZ+sPDeV1Dx6Ct89pIan9eCBN9uQl6MO3l8Dwe7zbNMNnog=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:07.567991 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-fd1b5814-c519-48e4-9080-2f725284140b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for project 356781184b3e4b409522e2a81d701fb5. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:31:07.571705 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-fd1b5814-c519-48e4-9080-2f725284140b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for user 0fd410fff845482ab3f04c7ccacf0d0a and project 356781184b3e4b409522e2a81d701fb5. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:31:07.593167 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fd1b5814-c519-48e4-9080-2f725284140b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042382 Jul 12 16:31:07.593749 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 499/1021] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 16:31:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:08.819448 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2006500189", "imageRef": "f24d5d65-df89-4bb7-99e9-155257771f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6031eeb-c9f6-49cf-b212-2e93a4763d32"}], "security_groups": [{"name": "tempest-securitygroup--1879876289"}], "key_name": "tempest-keypair-838742366", "user_data": "}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:08.917384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.network.neutron [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] validate_networks() for [('c6031eeb-c9f6-49cf-b212-2e93a4763d32', None, None, None, None, None)] {{(pid=117791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 16:31:09.269591 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Flavor limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 16:31:09.270021 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Image limits 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 16:31:09.270503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Flavor pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 16:31:09.270915 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Image pref 0:0:0 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 16:31:09.271335 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.virt.hardware [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 16:31:09.280512 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:09.280961 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:09.281794 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:09.282235 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:09.299450 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for project 356781184b3e4b409522e2a81d701fb5. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 16:31:09.303399 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.quota [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Getting quotas for user 0fd410fff845482ab3f04c7ccacf0d0a and project 356781184b3e4b409522e2a81d701fb5. Resources: {'cores', 'instances', 'ram'} {{(pid=117791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 16:31:09.314180 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Going to run 1 instances... {{(pid=117791) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 16:31:09.316399 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f24d5d65-df89-4bb7-99e9-155257771f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 16:31:09.364055 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-ffcf5072-0c5b-421e-89dd-a82f75dcede7 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.549754 Jul 12 16:31:09.364706 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 523/1022] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 16:31:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 16:31:09.375049 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-45f88be0-7c44-4931-a267-da5ff713e64c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:09.375660 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-45f88be0-7c44-4931-a267-da5ff713e64c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:09.435007 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-45f88be0-7c44-4931-a267-da5ff713e64c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:09.441698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-45f88be0-7c44-4931-a267-da5ff713e64c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1237 microversion: 2.1 time: 0.070943 Jul 12 16:31:09.442263 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 500/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:09 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:10.459889 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:10.461270 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:10.468835 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:10.469535 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:10.470581 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:10.471194 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:10.547775 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:10.555605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-b27e5336-a9cb-4337-a602-2a00885ce6ea tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1295 microversion: 2.1 time: 0.100538 Jul 12 16:31:10.556464 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 524/1024] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:10 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:11.574020 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:11.574760 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:11.581693 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:11.582567 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:11.583788 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:11.583994 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:11.932868 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-815a5257-1194-4115-9c6c-4e66d30889d2 req-36f85977-449f-45eb-ade2-1c347d4f65a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85708ab9-1690-421b-8516-3daeda209bbe", "tag": "80753029-751c-44d4-a9ca-3450b0f5f3a6"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:11.942494 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-815a5257-1194-4115-9c6c-4e66d30889d2 req-36f85977-449f-45eb-ade2-1c347d4f65a8 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:11.942974 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-815a5257-1194-4115-9c6c-4e66d30889d2 req-36f85977-449f-45eb-ade2-1c347d4f65a8 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:11.954734 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-815a5257-1194-4115-9c6c-4e66d30889d2 req-36f85977-449f-45eb-ade2-1c347d4f65a8 service nova] Creating event network-changed:80753029-751c-44d4-a9ca-3450b0f5f3a6 for instance 85708ab9-1690-421b-8516-3daeda209bbe on hv-cinder-79760 Jul 12 16:31:11.965877 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-815a5257-1194-4115-9c6c-4e66d30889d2 req-36f85977-449f-45eb-ade2-1c347d4f65a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037311 Jul 12 16:31:11.967026 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 525/1025] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:12.043550 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:12.051701 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f4ec5440-abad-4b52-9c4c-748c84f1d960 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1363 microversion: 2.1 time: 0.482917 Jul 12 16:31:12.053159 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 501/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:11 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:13.071853 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:13.072503 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:13.078673 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:13.079123 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:13.079882 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:13.080318 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:13.209334 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:13.217235 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-24877d19-7796-44b0-aff9-fe4fb342c7bc tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1363 microversion: 2.1 time: 0.150768 Jul 12 16:31:13.217788 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 526/1027] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:13 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:31:14.234526 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:14.235142 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:14.241521 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:14.241980 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:14.242746 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:14.243242 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:14.375986 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:14.383506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5a899508-890e-44e4-99ca-e4e841266c61 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1363 microversion: 2.1 time: 0.153138 Jul 12 16:31:14.384082 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 502/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:14 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:15.399189 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:15.400337 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:15.406815 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:15.407264 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:15.408019 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:15.408455 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:15.533201 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:15.540448 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-00e88ca5-50ee-4630-b179-fb89d436a423 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1363 microversion: 2.1 time: 0.145212 Jul 12 16:31:15.541011 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 527/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:15 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:16.557260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:16.557936 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:16.564428 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:16.564877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:16.565678 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:16.566117 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:16.691771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:16.699182 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d81ff15e-eb73-4a4c-9496-ddef10a3f71b tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1363 microversion: 2.1 time: 0.146013 Jul 12 16:31:16.699736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 503/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:16 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:17.715810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:17.716408 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:17.723014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:17.723454 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:17.724214 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:17.724646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:17.848518 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:17.856632 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-5d5b026d-82ff-4572-b210-dfc5e5673c5f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1363 microversion: 2.1 time: 0.144702 Jul 12 16:31:17.857219 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 528/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:17 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:18.116339 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-f02babfd-f5da-4615-ac09-46742f5a732c req-061e94ba-1b5f-4e50-9864-eb2ca189a19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85708ab9-1690-421b-8516-3daeda209bbe", "name": "network-vif-plugged", "status": "completed", "tag": "80753029-751c-44d4-a9ca-3450b0f5f3a6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:18.125513 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f02babfd-f5da-4615-ac09-46742f5a732c req-061e94ba-1b5f-4e50-9864-eb2ca189a19c service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:18.125951 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f02babfd-f5da-4615-ac09-46742f5a732c req-061e94ba-1b5f-4e50-9864-eb2ca189a19c service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:18.137423 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-f02babfd-f5da-4615-ac09-46742f5a732c req-061e94ba-1b5f-4e50-9864-eb2ca189a19c service nova] Creating event network-vif-plugged:80753029-751c-44d4-a9ca-3450b0f5f3a6 for instance 85708ab9-1690-421b-8516-3daeda209bbe on hv-cinder-79760 Jul 12 16:31:18.142295 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-f02babfd-f5da-4615-ac09-46742f5a732c req-061e94ba-1b5f-4e50-9864-eb2ca189a19c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029602 Jul 12 16:31:18.142875 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 504/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:18.873641 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:18.874243 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:18.880655 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:18.881121 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:18.881870 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:18.882306 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:19.011958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:19.019346 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-827097fd-86dc-4858-bd2b-51564cb2fd22 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1363 microversion: 2.1 time: 0.149494 Jul 12 16:31:19.019897 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 529/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:18 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:20.036249 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:20.036847 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:20.039260 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:20.045078 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:20.045558 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:20.046335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:20.046776 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:20.176058 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:20.184041 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6b2c2683-adb4-4597-ac6f-b7fddae711e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1549 microversion: 2.1 time: 0.152059 Jul 12 16:31:20.184617 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 505/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:20 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:31:20.200620 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-50325fe0-5a43-44a8-b1ea-b6e89be5a192 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:20.201216 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-50325fe0-5a43-44a8-b1ea-b6e89be5a192 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:20.203250 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:20.203894 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell0:SELECT=6 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:20.210012 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50325fe0-5a43-44a8-b1ea-b6e89be5a192 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:20.210454 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50325fe0-5a43-44a8-b1ea-b6e89be5a192 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:20.211205 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50325fe0-5a43-44a8-b1ea-b6e89be5a192 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:20.211662 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-50325fe0-5a43-44a8-b1ea-b6e89be5a192 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:20.286435 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-50325fe0-5a43-44a8-b1ea-b6e89be5a192 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090045 Jul 12 16:31:20.286961 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 530/1035] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 16:31:20 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:21.181640 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-5636511c-270f-4a6f-8baa-f9817b12c24c req-761637e3-32e4-4e98-9681-983a37a8bbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85708ab9-1690-421b-8516-3daeda209bbe", "tag": "80753029-751c-44d4-a9ca-3450b0f5f3a6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:21.190301 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5636511c-270f-4a6f-8baa-f9817b12c24c req-761637e3-32e4-4e98-9681-983a37a8bbd7 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:21.190745 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5636511c-270f-4a6f-8baa-f9817b12c24c req-761637e3-32e4-4e98-9681-983a37a8bbd7 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:21.201549 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-5636511c-270f-4a6f-8baa-f9817b12c24c req-761637e3-32e4-4e98-9681-983a37a8bbd7 service nova] Creating event network-changed:80753029-751c-44d4-a9ca-3450b0f5f3a6 for instance 85708ab9-1690-421b-8516-3daeda209bbe on hv-cinder-79760 Jul 12 16:31:21.207692 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-5636511c-270f-4a6f-8baa-f9817b12c24c req-761637e3-32e4-4e98-9681-983a37a8bbd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030373 Jul 12 16:31:21.208307 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 506/1036] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:38.670044 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:38.670790 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:38.670932 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:38.672077 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:38.675141 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-e4cdd17c-da91-440d-8a9c-0c4abe378d6e req-9257680f-0a79-465d-81db-e929ac0140a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb46700-8d74-49a9-a92e-f22563958da5", "tag": "aa975210-47f5-4df6-951a-8aa3b2c61b0d"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:38.675404 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:38.676361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=64 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:38.682361 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:38.683237 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:38.684288 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:38.684851 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:38.685599 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e4cdd17c-da91-440d-8a9c-0c4abe378d6e req-9257680f-0a79-465d-81db-e929ac0140a7 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:38.686114 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e4cdd17c-da91-440d-8a9c-0c4abe378d6e req-9257680f-0a79-465d-81db-e929ac0140a7 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:38.699686 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-e4cdd17c-da91-440d-8a9c-0c4abe378d6e req-9257680f-0a79-465d-81db-e929ac0140a7 service nova] Creating event network-changed:aa975210-47f5-4df6-951a-8aa3b2c61b0d for instance 1bb46700-8d74-49a9-a92e-f22563958da5 on hv-cinder-79760 Jul 12 16:31:38.704761 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-e4cdd17c-da91-440d-8a9c-0c4abe378d6e req-9257680f-0a79-465d-81db-e929ac0140a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036056 Jul 12 16:31:38.705780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 507/1037] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:38.715383 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:31:38.793277 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e254f5fb-5732-44f5-aea5-e87ffc89892c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 204 len: 0 microversion: 2.1 time: 0.126507 Jul 12 16:31:38.794397 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 531/1038] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:31:38 2022] DELETE /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:31:38.803478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:38.804050 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:38.810698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:38.811143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:38.811967 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:38.812407 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:38.972818 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:38.980896 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c62ef54e-8849-4986-a675-1700faa4fb93 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1579 microversion: 2.1 time: 0.182034 Jul 12 16:31:38.981498 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 508/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:38 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1579 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:39.999174 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:40.000031 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:40.006269 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:40.006720 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:40.007488 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:40.007928 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:40.141498 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:40.149282 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-65a3faf4-1dde-40b8-8633-82d8024b18db tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1579 microversion: 2.1 time: 0.154640 Jul 12 16:31:40.149850 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 532/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:39 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:31:41.168629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:41.169259 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:41.175642 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:41.176086 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:41.176990 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:41.177366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:41.303365 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:41.310770 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b8ba5b35-a0bf-4f92-b04d-8b3a9183e209 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1579 microversion: 2.1 time: 0.146628 Jul 12 16:31:41.311330 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 509/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:41 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1579 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:42.327688 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:42.328302 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:42.334737 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:42.335188 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:42.335951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:42.336384 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:42.461572 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:42.468957 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-3f6be4d0-8174-462d-a776-23b8e06c1367 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1579 microversion: 2.1 time: 0.145182 Jul 12 16:31:42.469588 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 533/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:42 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1579 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:43.486261 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:43.486877 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:43.493201 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:43.493650 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:43.494460 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:43.494892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:43.799777 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:43.807214 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-637d0291-bec7-4162-bf38-b3e509dfb73e tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1579 microversion: 2.1 time: 0.324862 Jul 12 16:31:43.808396 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 510/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:43 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1579 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:44.201248 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-fdcc818a-0d70-4174-a3d9-925e838e367d req-7ceacbf8-8b35-4dea-afd8-2a89868cb700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb46700-8d74-49a9-a92e-f22563958da5", "name": "network-vif-unplugged", "status": "completed", "tag": "aa975210-47f5-4df6-951a-8aa3b2c61b0d"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:44.209305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-fdcc818a-0d70-4174-a3d9-925e838e367d req-7ceacbf8-8b35-4dea-afd8-2a89868cb700 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:44.209750 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-fdcc818a-0d70-4174-a3d9-925e838e367d req-7ceacbf8-8b35-4dea-afd8-2a89868cb700 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:44.221338 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-fdcc818a-0d70-4174-a3d9-925e838e367d req-7ceacbf8-8b35-4dea-afd8-2a89868cb700 service nova] Creating event network-vif-unplugged:aa975210-47f5-4df6-951a-8aa3b2c61b0d for instance 1bb46700-8d74-49a9-a92e-f22563958da5 on hv-cinder-79760 Jul 12 16:31:44.226257 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-fdcc818a-0d70-4174-a3d9-925e838e367d req-7ceacbf8-8b35-4dea-afd8-2a89868cb700 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028963 Jul 12 16:31:44.226849 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 534/1044] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:44.825264 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:44.825915 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:44.832506 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:44.832955 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:44.833751 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:44.834197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:44.964294 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:44.971881 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f47c14b2-d10c-462c-81d2-1e21c1e41bfd tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1579 microversion: 2.1 time: 0.151042 Jul 12 16:31:44.972446 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 511/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:44 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:45.990418 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:45.991119 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:45.997703 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:45.998285 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:45.999066 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:45.999504 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:46.027017 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-586935b6-2aa6-4963-ab94-08ab942ed95b req-e34415ff-975a-4d9e-ae51-77e9a19c7417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb46700-8d74-49a9-a92e-f22563958da5", "name": "network-vif-deleted", "tag": "aa975210-47f5-4df6-951a-8aa3b2c61b0d"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:46.035721 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-586935b6-2aa6-4963-ab94-08ab942ed95b req-e34415ff-975a-4d9e-ae51-77e9a19c7417 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:46.036140 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-586935b6-2aa6-4963-ab94-08ab942ed95b req-e34415ff-975a-4d9e-ae51-77e9a19c7417 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:46.047737 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-586935b6-2aa6-4963-ab94-08ab942ed95b req-e34415ff-975a-4d9e-ae51-77e9a19c7417 service nova] Creating event network-vif-deleted:aa975210-47f5-4df6-951a-8aa3b2c61b0d for instance 1bb46700-8d74-49a9-a92e-f22563958da5 on hv-cinder-79760 Jul 12 16:31:46.052845 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-586935b6-2aa6-4963-ab94-08ab942ed95b req-e34415ff-975a-4d9e-ae51-77e9a19c7417 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029953 Jul 12 16:31:46.053874 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 512/1046] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:31:46.121387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:46.128812 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-84c15dce-fb94-4182-941e-c9b557a97e4c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 200 len: 1392 microversion: 2.1 time: 0.143339 Jul 12 16:31:46.129411 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 535/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:45 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 1392 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:47.147499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:47.148115 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: 1bb46700-8d74-49a9-a92e-f22563958da5] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:47.154784 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:47.155226 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:47.155975 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:47.156404 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:47.169856 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] HTTP exception thrown: Instance 1bb46700-8d74-49a9-a92e-f22563958da5 could not be found. Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Request method failure captured: Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 HTTP/1.1 Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaAFkdQsoz9z1MtMsf9cN9wI-tx3TOxxdb9W998AyoH536ts8fSP_kApFHBIshMfgdBsAR-wb-J2KdVd5HHQQL3ooe579AkJMoSGvt-9HCUOkrC6vkZWRPkNQGsCymoG_MA_VkoXEzSMksbdiInw_J5Ds03OY2apEzvdYzvlrv9_Ox4 Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:31:47.171438 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dca15cc5b53b4c51a9f7a6ce0f827ebd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: a69aa7a2c98d4f30a5585c89e5295eb7 Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 1bb46700-8d74-49a9-a92e-f22563958da5 could not be found. Jul 12 16:31:47.173143 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '1bb46700-8d74-49a9-a92e-f22563958da5'} Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb46700-8d74-49a9-a92e-f22563958da5 could not be found. Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:31:47.174120 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb46700-8d74-49a9-a92e-f22563958da5 could not be found. Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb46700-8d74-49a9-a92e-f22563958da5 could not be found. Jul 12 16:31:47.175717 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:47.177145 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Returning 404 to user: Instance 1bb46700-8d74-49a9-a92e-f22563958da5 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:31:47.177145 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9cc8f2ba-1973-453b-8a03-13b571e828f9 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5" status: 404 len: 111 microversion: 2.1 time: 0.030100 Jul 12 16:31:47.177145 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 513/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:47 2022] GET /compute/v2.1/servers/1bb46700-8d74-49a9-a92e-f22563958da5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:50.212883 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:50.213405 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:50.214667 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-9312838e-5dd1-415b-8010-fbc485124246 req-ab4b41c5-1114-44ca-9d5c-8b6ffd562388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3150f6-a658-4e6f-9692-d05e0d350072", "tag": "c8923a42-4682-40f9-9ae7-84a0f1a561d6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:50.219759 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:50.223585 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-9312838e-5dd1-415b-8010-fbc485124246 req-ab4b41c5-1114-44ca-9d5c-8b6ffd562388 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:50.224324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-9312838e-5dd1-415b-8010-fbc485124246 req-ab4b41c5-1114-44ca-9d5c-8b6ffd562388 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:50.224493 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:50.228318 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:50.228851 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:50.236152 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-9312838e-5dd1-415b-8010-fbc485124246 req-ab4b41c5-1114-44ca-9d5c-8b6ffd562388 service nova] Creating event network-changed:c8923a42-4682-40f9-9ae7-84a0f1a561d6 for instance ac3150f6-a658-4e6f-9692-d05e0d350072 on hv-cinder-79760 Jul 12 16:31:50.241886 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-9312838e-5dd1-415b-8010-fbc485124246 req-ab4b41c5-1114-44ca-9d5c-8b6ffd562388 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031123 Jul 12 16:31:50.242797 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 514/1049] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:31:50.274930 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Going to try to terminate instance {{(pid=117791) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:31:50.382159 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-0e0c9c35-69c4-4413-8b84-078cfb829699 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 204 len: 0 microversion: 2.1 time: 0.173536 Jul 12 16:31:50.383620 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 536/1050] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:31:50 2022] DELETE /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:31:50.392629 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:50.393434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:50.399792 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:50.400241 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:50.401001 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:50.401707 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:50.540229 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:50.548494 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-325bdde3-73d3-46c5-bf59-8174d25824c2 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1577 microversion: 2.1 time: 0.160148 Jul 12 16:31:50.549085 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 515/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:50 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:31:51.566778 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:51.567516 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:51.574617 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:51.575075 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:51.575846 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:51.576283 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:51.958266 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:51.965689 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-7ade9477-128a-4c28-a679-4a07fcf9615d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1577 microversion: 2.1 time: 0.403175 Jul 12 16:31:51.966255 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 537/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:51 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1577 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:52.932894 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-b203ca33-f238-4a6a-a144-b949fa07181e req-43d21153-6a06-46fe-b4b2-8523107dda97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3150f6-a658-4e6f-9692-d05e0d350072", "name": "network-vif-deleted", "tag": "c8923a42-4682-40f9-9ae7-84a0f1a561d6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:52.944162 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b203ca33-f238-4a6a-a144-b949fa07181e req-43d21153-6a06-46fe-b4b2-8523107dda97 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:52.944624 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b203ca33-f238-4a6a-a144-b949fa07181e req-43d21153-6a06-46fe-b4b2-8523107dda97 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:52.958467 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-b203ca33-f238-4a6a-a144-b949fa07181e req-43d21153-6a06-46fe-b4b2-8523107dda97 service nova] Creating event network-vif-deleted:c8923a42-4682-40f9-9ae7-84a0f1a561d6 for instance ac3150f6-a658-4e6f-9692-d05e0d350072 on hv-cinder-79760 Jul 12 16:31:52.965308 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-b203ca33-f238-4a6a-a144-b949fa07181e req-43d21153-6a06-46fe-b4b2-8523107dda97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035846 Jul 12 16:31:52.965913 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 516/1053] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:52.982873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:52.983485 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:52.991300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:52.991749 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:52.992506 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:52.992938 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:53.053766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69aa7a2c98d4f30a5585c89e5295eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca15cc5b53b4c51a9f7a6ce0f827ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:31:53.061117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4a0e7146-9778-4ca9-ae59-9b7675e16dde tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 200 len: 1225 microversion: 2.1 time: 0.082377 Jul 12 16:31:53.061676 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 538/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:52 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:31:54.078500 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:54.079201 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: ac3150f6-a658-4e6f-9692-d05e0d350072] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:54.085855 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:54.086310 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:54.087078 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:54.087522 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:54.105974 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] HTTP exception thrown: Instance ac3150f6-a658-4e6f-9692-d05e0d350072 could not be found. Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Request method failure captured: Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 HTTP/1.1 Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaAFkdQsoz9z1MtMsf9cN9wI-tx3TOxxdb9W998AyoH536ts8fSP_kApFHBIshMfgdBsAR-wb-J2KdVd5HHQQL3ooe579AkJMoSGvt-9HCUOkrC6vkZWRPkNQGsCymoG_MA_VkoXEzSMksbdiInw_J5Ds03OY2apEzvdYzvlrv9_Ox4 Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:31:54.107309 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dca15cc5b53b4c51a9f7a6ce0f827ebd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: a69aa7a2c98d4f30a5585c89e5295eb7 Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance ac3150f6-a658-4e6f-9692-d05e0d350072 could not be found. Jul 12 16:31:54.108780 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'ac3150f6-a658-4e6f-9692-d05e0d350072'} Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac3150f6-a658-4e6f-9692-d05e0d350072 could not be found. Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:31:54.109982 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac3150f6-a658-4e6f-9692-d05e0d350072 could not be found. Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac3150f6-a658-4e6f-9692-d05e0d350072 could not be found. Jul 12 16:31:54.111764 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.113879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Returning 404 to user: Instance ac3150f6-a658-4e6f-9692-d05e0d350072 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:31:54.113879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-339b379b-5ccf-4658-9c50-d869ccd0cbd7 tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072" status: 404 len: 111 microversion: 2.1 time: 0.034483 Jul 12 16:31:54.113879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 517/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:54 2022] GET /compute/v2.1/servers/ac3150f6-a658-4e6f-9692-d05e0d350072 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:54.542117 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:54.542622 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:54.549074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:54.549534 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:54.550300 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:54.550737 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:54.564078 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] HTTP exception thrown: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Request method failure captured: Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 HTTP/1.1 Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaAFkdQsoz9z1MtMsf9cN9wI-tx3TOxxdb9W998AyoH536ts8fSP_kApFHBIshMfgdBsAR-wb-J2KdVd5HHQQL3ooe579AkJMoSGvt-9HCUOkrC6vkZWRPkNQGsCymoG_MA_VkoXEzSMksbdiInw_J5Ds03OY2apEzvdYzvlrv9_Ox4 Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:31:54.565863 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dca15cc5b53b4c51a9f7a6ce0f827ebd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: a69aa7a2c98d4f30a5585c89e5295eb7 Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.567523 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': 'e7a46c12-84ab-439b-8713-9f1c53c96387'} Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:31:54.568582 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.570165 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.571881 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Returning 404 to user: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:31:54.571881 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-e47b00e9-9175-4943-83d0-d67a451e6b9c tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 404 len: 111 microversion: 2.1 time: 0.029078 Jul 12 16:31:54.571881 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 539/1056] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:31:54 2022] DELETE /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:54.576390 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:54.576998 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] [instance: e7a46c12-84ab-439b-8713-9f1c53c96387] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:54.583058 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:54.583530 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:54.584304 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:54.584736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:54.598412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] HTTP exception thrown: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Request method failure captured: Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 HTTP/1.1 Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaAFkdQsoz9z1MtMsf9cN9wI-tx3TOxxdb9W998AyoH536ts8fSP_kApFHBIshMfgdBsAR-wb-J2KdVd5HHQQL3ooe579AkJMoSGvt-9HCUOkrC6vkZWRPkNQGsCymoG_MA_VkoXEzSMksbdiInw_J5Ds03OY2apEzvdYzvlrv9_Ox4 Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:31:54.599901 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca15cc5b53b4c51a9f7a6ce0f827ebd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dca15cc5b53b4c51a9f7a6ce0f827ebd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: dca15cc5b53b4c51a9f7a6ce0f827ebd Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-2028141322 Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: a69aa7a2c98d4f30a5585c89e5295eb7 Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-2028141322-project Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.601609 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': 'e7a46c12-84ab-439b-8713-9f1c53c96387'} Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:31:54.602447 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. Jul 12 16:31:54.603689 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:31:54.604834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Returning 404 to user: Instance e7a46c12-84ab-439b-8713-9f1c53c96387 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:31:54.604834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-91c95242-ae67-4452-adea-a4625c71c0ce tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387" status: 404 len: 111 microversion: 2.1 time: 0.029300 Jul 12 16:31:54.604834 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 518/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:31:54 2022] GET /compute/v2.1/servers/e7a46c12-84ab-439b-8713-9f1c53c96387 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:55.884964 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-c4aaaf6c-8e20-45f3-afd3-17eb227b333d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] Calling method '.version_select at 0x7f1da59af280>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:55.905038 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-c4aaaf6c-8e20-45f3-afd3-17eb227b333d tempest-TestVolumeBootPattern-2028141322 tempest-TestVolumeBootPattern-2028141322-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1223961137" status: 202 len: 0 microversion: 2.1 time: 0.023837 Jul 12 16:31:55.905768 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 540/1058] 10.222.0.20 () {58 vars in 1262 bytes} [Tue Jul 12 16:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1223961137 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:31:57.247289 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-26390a6c-44f2-4deb-b593-3a48a9b0c7e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:31:57.247858 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-26390a6c-44f2-4deb-b593-3a48a9b0c7e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:57.254206 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26390a6c-44f2-4deb-b593-3a48a9b0c7e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:57.254658 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26390a6c-44f2-4deb-b593-3a48a9b0c7e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:57.255418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26390a6c-44f2-4deb-b593-3a48a9b0c7e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:57.255848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26390a6c-44f2-4deb-b593-3a48a9b0c7e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:57.283958 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-26390a6c-44f2-4deb-b593-3a48a9b0c7e5 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/ips" status: 200 len: 146 microversion: 2.1 time: 0.041200 Jul 12 16:31:57.284895 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 519/1059] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 16:31:57 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:31:58.645631 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-4121656f-4b35-4c06-8f9e-1ed206ea4665 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "327c60b5-ed82-4bdf-ae9f-159e43e9d276"}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:31:58.646692 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-4121656f-4b35-4c06-8f9e-1ed206ea4665 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:31:58.653611 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4121656f-4b35-4c06-8f9e-1ed206ea4665 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:58.654071 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4121656f-4b35-4c06-8f9e-1ed206ea4665 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:58.654848 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4121656f-4b35-4c06-8f9e-1ed206ea4665 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:31:58.655291 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-4121656f-4b35-4c06-8f9e-1ed206ea4665 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:31:58.953424 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-4121656f-4b35-4c06-8f9e-1ed206ea4665 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312150 Jul 12 16:31:58.960499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 541/1060] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:31:58 2022] POST /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:32:00.911228 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:32:00.911970 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Tue Jul 12 16:32:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:32:05.426646 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-135a692b-7cac-49c3-ba17-8dd676bc6f92 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:05.427579 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-135a692b-7cac-49c3-ba17-8dd676bc6f92 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:05.435592 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-135a692b-7cac-49c3-ba17-8dd676bc6f92 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:05.436049 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-135a692b-7cac-49c3-ba17-8dd676bc6f92 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:05.436848 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-135a692b-7cac-49c3-ba17-8dd676bc6f92 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:05.437325 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-135a692b-7cac-49c3-ba17-8dd676bc6f92 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:05.465821 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-135a692b-7cac-49c3-ba17-8dd676bc6f92 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043243 Jul 12 16:32:05.466366 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 520/1061] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:32:05 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:32:05.477613 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-1d634478-73ac-4655-b235-98002c466a32 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:05.478189 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-1d634478-73ac-4655-b235-98002c466a32 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:05.485371 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1d634478-73ac-4655-b235-98002c466a32 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:05.485857 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1d634478-73ac-4655-b235-98002c466a32 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:05.486677 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1d634478-73ac-4655-b235-98002c466a32 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:05.487111 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-1d634478-73ac-4655-b235-98002c466a32 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:05.515456 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-1d634478-73ac-4655-b235-98002c466a32 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/327c60b5-ed82-4bdf-ae9f-159e43e9d276" status: 200 len: 194 microversion: 2.1 time: 0.042775 Jul 12 16:32:05.515958 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 542/1062] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 12 16:32:05 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/327c60b5-ed82-4bdf-ae9f-159e43e9d276 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:32:06.838879 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-09fe9e93-1e1f-41ec-b337-4973ab35fa18 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24efe8c0-2878-48d2-b5d5-37b6fae135cf"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:32:06.840440 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-09fe9e93-1e1f-41ec-b337-4973ab35fa18 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:06.846854 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09fe9e93-1e1f-41ec-b337-4973ab35fa18 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:06.847300 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09fe9e93-1e1f-41ec-b337-4973ab35fa18 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:06.848048 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09fe9e93-1e1f-41ec-b337-4973ab35fa18 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:06.848478 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09fe9e93-1e1f-41ec-b337-4973ab35fa18 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:07.084364 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-09fe9e93-1e1f-41ec-b337-4973ab35fa18 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "POST /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249249 Jul 12 16:32:07.084999 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 521/1063] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 16:32:06 2022] POST /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:32:14.554953 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-d15b8b60-73b2-47a2-ac12-d57f4417543a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:14.555925 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-d15b8b60-73b2-47a2-ac12-d57f4417543a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:14.559074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:14.564311 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d15b8b60-73b2-47a2-ac12-d57f4417543a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:14.564757 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d15b8b60-73b2-47a2-ac12-d57f4417543a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:14.565542 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d15b8b60-73b2-47a2-ac12-d57f4417543a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:14.565972 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-d15b8b60-73b2-47a2-ac12-d57f4417543a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:14.568992 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:14.597471 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-d15b8b60-73b2-47a2-ac12-d57f4417543a tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046411 Jul 12 16:32:14.598014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 543/1064] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:32:14 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:32:14.747404 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0367d185-f9d4-47d9-8f04-ae6c235ca76f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:14.747922 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0367d185-f9d4-47d9-8f04-ae6c235ca76f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:14.749828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=31 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:14.755254 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0367d185-f9d4-47d9-8f04-ae6c235ca76f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:14.755698 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0367d185-f9d4-47d9-8f04-ae6c235ca76f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:14.756458 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0367d185-f9d4-47d9-8f04-ae6c235ca76f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:14.756893 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0367d185-f9d4-47d9-8f04-ae6c235ca76f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:14.760585 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:14.786529 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0367d185-f9d4-47d9-8f04-ae6c235ca76f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/327c60b5-ed82-4bdf-ae9f-159e43e9d276" status: 200 len: 194 microversion: 2.1 time: 0.044597 Jul 12 16:32:14.787095 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 522/1065] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 12 16:32:14 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/327c60b5-ed82-4bdf-ae9f-159e43e9d276 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:32:14.797168 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:14.797680 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:14.803619 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:14.804063 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:14.804813 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:14.805280 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:14.883305 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lazy-loading 'services' on Instance uuid 85708ab9-1690-421b-8516-3daeda209bbe {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:32:14.951170 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-01867ce1-03ef-48af-9170-4c22b4c4d025 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/327c60b5-ed82-4bdf-ae9f-159e43e9d276" status: 202 len: 0 microversion: 2.1 time: 0.157825 Jul 12 16:32:14.951771 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 544/1066] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:32:14 2022] DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/327c60b5-ed82-4bdf-ae9f-159e43e9d276 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:32:16.067432 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b46fd61a-f86a-4f4c-b968-cafd204ff98c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:16.068039 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b46fd61a-f86a-4f4c-b968-cafd204ff98c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:16.075196 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b46fd61a-f86a-4f4c-b968-cafd204ff98c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:16.075648 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b46fd61a-f86a-4f4c-b968-cafd204ff98c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:16.076859 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b46fd61a-f86a-4f4c-b968-cafd204ff98c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:16.077329 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b46fd61a-f86a-4f4c-b968-cafd204ff98c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:16.106771 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b46fd61a-f86a-4f4c-b968-cafd204ff98c tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/24efe8c0-2878-48d2-b5d5-37b6fae135cf" status: 200 len: 194 microversion: 2.1 time: 0.043314 Jul 12 16:32:16.107356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 523/1067] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 12 16:32:16 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/24efe8c0-2878-48d2-b5d5-37b6fae135cf => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:32:16.118366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:16.118942 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:16.125230 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:16.125688 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:16.126452 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:16.126887 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:16.205431 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.objects.instance [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lazy-loading 'services' on Instance uuid 85708ab9-1690-421b-8516-3daeda209bbe {{(pid=117791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 16:32:16.274028 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-02ffb58a-c9da-41a9-96c9-9bdc4af95810 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/24efe8c0-2878-48d2-b5d5-37b6fae135cf" status: 202 len: 0 microversion: 2.1 time: 0.160464 Jul 12 16:32:16.274596 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 545/1068] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 16:32:16 2022] DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments/24efe8c0-2878-48d2-b5d5-37b6fae135cf => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:32:17.432060 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cb38c4aa-6d3d-498f-918d-9b015b88218d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:17.433087 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cb38c4aa-6d3d-498f-918d-9b015b88218d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:17.439486 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb38c4aa-6d3d-498f-918d-9b015b88218d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.439941 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb38c4aa-6d3d-498f-918d-9b015b88218d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.440722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb38c4aa-6d3d-498f-918d-9b015b88218d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.441189 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb38c4aa-6d3d-498f-918d-9b015b88218d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.469683 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cb38c4aa-6d3d-498f-918d-9b015b88218d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041508 Jul 12 16:32:17.470234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 524/1069] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:32:17 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:32:17.571330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6bf75111-6a35-4346-b40c-6897f2969f5e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:17.572330 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6bf75111-6a35-4346-b40c-6897f2969f5e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:17.579000 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bf75111-6a35-4346-b40c-6897f2969f5e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.579394 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bf75111-6a35-4346-b40c-6897f2969f5e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.580154 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bf75111-6a35-4346-b40c-6897f2969f5e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.580595 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6bf75111-6a35-4346-b40c-6897f2969f5e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.608816 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6bf75111-6a35-4346-b40c-6897f2969f5e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042315 Jul 12 16:32:17.609440 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 546/1070] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 16:32:17 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:32:17.664507 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:17.665031 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:17.671072 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.671520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.672282 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.672722 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.696335 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:32:17.769736 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0e999821-5fe7-45b5-95f1-43726a896496 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 204 len: 0 microversion: 2.1 time: 0.108827 Jul 12 16:32:17.770429 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 525/1071] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:32:17 2022] DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 16:32:17.779079 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:17.779670 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:17.785600 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.786052 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.786810 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:17.787244 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:17.918259 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:32:17.925695 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-99776a80-9552-44b9-a9d2-021902ddf89d tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1674 microversion: 2.1 time: 0.151114 Jul 12 16:32:17.926284 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 547/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:32:17 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:32:18.943716 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:18.944412 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:18.951288 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:18.951731 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:18.952479 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:18.952910 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:19.083610 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:32:19.091587 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6885b114-117a-4bd2-adc6-7398942e8250 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1674 microversion: 2.1 time: 0.151535 Jul 12 16:32:19.092155 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 526/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:32:18 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:32:20.109325 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:20.109950 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:20.116720 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:20.117205 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:20.117972 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:20.118406 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:20.246840 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd410fff845482ab3f04c7ccacf0d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356781184b3e4b409522e2a81d701fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:32:20.254420 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-8fc30531-85c1-4a40-8e80-eb6f2c2d6333 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 200 len: 1674 microversion: 2.1 time: 0.149843 Jul 12 16:32:20.254991 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 548/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:32:20 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:32:20.629601 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-7cb91969-9c63-431b-aa9f-451696422379 req-bd245a79-6876-4a1e-a865-8cca56b7d2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85708ab9-1690-421b-8516-3daeda209bbe", "name": "network-vif-deleted", "tag": "80753029-751c-44d4-a9ca-3450b0f5f3a6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:32:20.638353 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7cb91969-9c63-431b-aa9f-451696422379 req-bd245a79-6876-4a1e-a865-8cca56b7d2d3 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:20.638796 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7cb91969-9c63-431b-aa9f-451696422379 req-bd245a79-6876-4a1e-a865-8cca56b7d2d3 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:20.653009 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-7cb91969-9c63-431b-aa9f-451696422379 req-bd245a79-6876-4a1e-a865-8cca56b7d2d3 service nova] Creating event network-vif-deleted:80753029-751c-44d4-a9ca-3450b0f5f3a6 for instance 85708ab9-1690-421b-8516-3daeda209bbe on hv-cinder-79760 Jul 12 16:32:20.658921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-7cb91969-9c63-431b-aa9f-451696422379 req-bd245a79-6876-4a1e-a865-8cca56b7d2d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Jul 12 16:32:20.659509 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 527/1075] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:32:21.271433 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:21.272150 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:21.279011 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:21.279756 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:21.280543 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:21.280982 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:21.295845 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] HTTP exception thrown: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Request method failure captured: Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe HTTP/1.1 Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaEE9gjD6oXJVdwTjDABxaYTFe-RzyDkshIe-S50rXHfU4JCDqlKXze0hkpEuSmLsVy2OlLdvwPmsLTHSSEmUjQL5dKwJTWVXdAAoLqHOGUvT_3xG1AQESEq_PLnYG09j30CYh1fg66v8MOrMyDYQUKeF0M9soXUznhJxNUhQi45ARg Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:32:21.297536 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_356781184b3e4b409522e2a81d701fb5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 0fd410fff845482ab3f04c7ccacf0d0a Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:21.299342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '85708ab9-1690-421b-8516-3daeda209bbe'} Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:32:21.300381 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:21.302053 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:21.303629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Returning 404 to user: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:32:21.303629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-6d2cc209-ce08-4b4f-9e4d-1a482b4c284e tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 404 len: 111 microversion: 2.1 time: 0.031441 Jul 12 16:32:21.303629 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 549/1076] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:32:21 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:21.309031 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2d1b284e-f854-4a35-abb3-43ff2256c215 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '.version_select at 0x7f1da59d9940>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:21.332434 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2d1b284e-f854-4a35-abb3-43ff2256c215 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838742366" status: 202 len: 0 microversion: 2.1 time: 0.027449 Jul 12 16:32:21.332933 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 528/1077] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 12 16:32:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838742366 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 16:32:24.447652 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:24.448170 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:24.454646 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:24.455086 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:24.455836 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:24.456265 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:24.469366 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] HTTP exception thrown: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Request method failure captured: Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe HTTP/1.1 Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaEE9gjD6oXJVdwTjDABxaYTFe-RzyDkshIe-S50rXHfU4JCDqlKXze0hkpEuSmLsVy2OlLdvwPmsLTHSSEmUjQL5dKwJTWVXdAAoLqHOGUvT_3xG1AQESEq_PLnYG09j30CYh1fg66v8MOrMyDYQUKeF0M9soXUznhJxNUhQi45ARg Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:32:24.470873 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_356781184b3e4b409522e2a81d701fb5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 0fd410fff845482ab3f04c7ccacf0d0a Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.472556 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '85708ab9-1690-421b-8516-3daeda209bbe'} Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:32:24.473612 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.475342 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.477008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Returning 404 to user: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:32:24.477008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-18f8e402-1ab2-48f7-974e-11190715050f tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 404 len: 111 microversion: 2.1 time: 0.028416 Jul 12 16:32:24.477008 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 550/1078] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:32:24 2022] DELETE /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:24.481325 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:24.482063 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 85708ab9-1690-421b-8516-3daeda209bbe] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:24.489197 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:24.489643 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:24.490401 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:24.490840 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:24.504324 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] HTTP exception thrown: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Request method failure captured: Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe HTTP/1.1 Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaEE9gjD6oXJVdwTjDABxaYTFe-RzyDkshIe-S50rXHfU4JCDqlKXze0hkpEuSmLsVy2OlLdvwPmsLTHSSEmUjQL5dKwJTWVXdAAoLqHOGUvT_3xG1AQESEq_PLnYG09j30CYh1fg66v8MOrMyDYQUKeF0M9soXUznhJxNUhQi45ARg Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:32:24.505954 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_356781184b3e4b409522e2a81d701fb5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 0fd410fff845482ab3f04c7ccacf0d0a Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.507540 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '85708ab9-1690-421b-8516-3daeda209bbe'} Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:32:24.508414 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. Jul 12 16:32:24.509767 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:24.510892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Returning 404 to user: Instance 85708ab9-1690-421b-8516-3daeda209bbe could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:32:24.510892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1bb2e191-3b1f-427f-87e6-91329b8f86bf tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe" status: 404 len: 111 microversion: 2.1 time: 0.030725 Jul 12 16:32:24.510892 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 529/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:32:24 2022] GET /compute/v2.1/servers/85708ab9-1690-421b-8516-3daeda209bbe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:25.639502 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:25.640014 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:25.646501 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:25.646951 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:25.647705 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:25.648132 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:25.661210 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.wsgi [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] HTTP exception thrown: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Request method failure captured: Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: request: DELETE /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b HTTP/1.1 Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept: application/json Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Accept-Encoding: identity Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Connection: close Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Length: 0 Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Content-Type: application/json Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Host: 10.222.0.20 Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Openstack-System-Scope: None Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: User-Agent: python-urllib3/1.26.9 Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Auth-Token: gAAAAABizaEE9gjD6oXJVdwTjDABxaYTFe-RzyDkshIe-S50rXHfU4JCDqlKXze0hkpEuSmLsVy2OlLdvwPmsLTHSSEmUjQL5dKwJTWVXdAAoLqHOGUvT_3xG1AQESEq_PLnYG09j30CYh1fg66v8MOrMyDYQUKeF0M9soXUznhJxNUhQi45ARg Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Id: None Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Domain-Name: None Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Identity-Status: Confirmed Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Is-Admin-Project: True Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Id: default Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Domain-Name: Default Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Project-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Role: reader,member Jul 12 16:32:25.662818 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Roles: reader,member Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_356781184b3e4b409522e2a81d701fb5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Id: default Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Domain-Name: Default Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Id: 0fd410fff845482ab3f04c7ccacf0d0a Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: X-User-Name: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: method: > Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: exception: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.664499 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: action_args: {'id': '854f546f-6c0c-4db8-bc32-286169fe686b'} Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:32:25.665362 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.666610 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.667902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Returning 404 to user: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. {{(pid=117791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:32:25.667902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-17a7c243-02ed-4a6b-98b2-d0192153f6dd tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 404 len: 111 microversion: 2.1 time: 0.029206 Jul 12 16:32:25.667902 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 551/1080] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:32:25 2022] DELETE /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:25.672798 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:32:25.673467 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] [instance: 854f546f-6c0c-4db8-bc32-286169fe686b] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:32:25.679849 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:25.680300 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:25.681075 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:32:25.681557 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:32:25.695322 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] HTTP exception thrown: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Request method failure captured: Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b HTTP/1.1 Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaEE9gjD6oXJVdwTjDABxaYTFe-RzyDkshIe-S50rXHfU4JCDqlKXze0hkpEuSmLsVy2OlLdvwPmsLTHSSEmUjQL5dKwJTWVXdAAoLqHOGUvT_3xG1AQESEq_PLnYG09j30CYh1fg66v8MOrMyDYQUKeF0M9soXUznhJxNUhQi45ARg Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:32:25.696815 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/356781184b3e4b409522e2a81d701fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_356781184b3e4b409522e2a81d701fb5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 356781184b3e4b409522e2a81d701fb5 Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341849580 Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: 0fd410fff845482ab3f04c7ccacf0d0a Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeTestJSON-1341849580-project Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.698422 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '854f546f-6c0c-4db8-bc32-286169fe686b'} Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:32:25.699315 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. Jul 12 16:32:25.700828 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:32:25.702323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] Returning 404 to user: Instance 854f546f-6c0c-4db8-bc32-286169fe686b could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:32:25.702323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-57e5e41b-c493-4ffd-8983-fe45ed30cd07 tempest-AttachVolumeTestJSON-1341849580 tempest-AttachVolumeTestJSON-1341849580-project] 10.222.0.20 "GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b" status: 404 len: 111 microversion: 2.1 time: 0.029773 Jul 12 16:32:25.702323 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 530/1081] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:32:25 2022] GET /compute/v2.1/servers/854f546f-6c0c-4db8-bc32-286169fe686b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:33:43.206387 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:33:43.207024 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Tue Jul 12 16:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:33:45.699747 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_api:SELECT=17 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:45.700490 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG dbcounter [-] [117791] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2 {{(pid=117791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:45.705031 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-a0d303fc-a02f-4a60-8b8d-3c788b7add5b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:33:45.706065 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-a0d303fc-a02f-4a60-8b8d-3c788b7add5b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:33:45.713871 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a0d303fc-a02f-4a60-8b8d-3c788b7add5b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:45.714317 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a0d303fc-a02f-4a60-8b8d-3c788b7add5b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:45.715081 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a0d303fc-a02f-4a60-8b8d-3c788b7add5b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:45.715513 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-a0d303fc-a02f-4a60-8b8d-3c788b7add5b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:45.793442 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-a0d303fc-a02f-4a60-8b8d-3c788b7add5b tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "POST /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0/action" status: 200 len: 14 microversion: 2.1 time: 0.095390 Jul 12 16:33:45.794044 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 552/1082] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 16:33:45 2022] POST /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 16:33:46.841648 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:46.842392 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:46.846586 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:33:46.847103 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:33:46.855935 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:46.856420 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:46.857356 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:46.857796 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:46.888243 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 16:33:46.981563 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-6d3c0084-6d2e-41eb-9e0e-f4253dd046e1 req-1434f23d-41c8-4f41-92c9-3a7240a87c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420d5478-b9a8-440a-a872-e1f3f94f0fb0", "tag": "7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:33:46.987998 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0bd5d1a6-9a88-4d98-aab0-038241d53cfc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "DELETE /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 204 len: 0 microversion: 2.1 time: 0.148101 Jul 12 16:33:46.989222 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 531/1083] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 16:33:46 2022] DELETE /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 16:33:46.993605 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-6d3c0084-6d2e-41eb-9e0e-f4253dd046e1 req-1434f23d-41c8-4f41-92c9-3a7240a87c34 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:46.994054 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-6d3c0084-6d2e-41eb-9e0e-f4253dd046e1 req-1434f23d-41c8-4f41-92c9-3a7240a87c34 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:46.997878 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:33:46.998582 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:33:47.004499 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:47.004950 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:47.005309 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-6d3c0084-6d2e-41eb-9e0e-f4253dd046e1 req-1434f23d-41c8-4f41-92c9-3a7240a87c34 service nova] Creating event network-changed:7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc for instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 on hv-cinder-79760 Jul 12 16:33:47.005773 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:47.006214 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:47.010132 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-6d3c0084-6d2e-41eb-9e0e-f4253dd046e1 req-1434f23d-41c8-4f41-92c9-3a7240a87c34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167933 Jul 12 16:33:47.011031 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 553/1084] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 16:33:47.142043 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:33:47.149787 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bad5de0e-15cb-426d-b2cf-163af8743527 tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1565 microversion: 2.1 time: 0.155982 Jul 12 16:33:47.150449 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 532/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:33:46 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 16:33:48.170135 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:33:48.170766 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.compute.api [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117791) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:33:48.177445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:48.177892 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:48.178651 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:48.179086 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:48.308796 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.policy [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117791) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:33:48.316264 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-bcd17860-b27c-48e7-b0c5-c6512ea0388c tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1565 microversion: 2.1 time: 0.151068 Jul 12 16:33:48.317074 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 554/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:33:48 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:33:49.333915 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:33:49.334606 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:33:49.341234 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:49.341752 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:49.342580 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:49.343084 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:49.615122 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0360a875a74828874ef2a55f596be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50404e382aca4cd0b0e0321a0e5294ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 16:33:49.623501 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e259bd81-aa28-4a59-beeb-537d93ccbe5a tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 200 len: 1565 microversion: 2.1 time: 0.294137 Jul 12 16:33:49.624285 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 533/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:33:49 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 1565 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 16:33:49.887654 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [req-669cbf5a-2288-4956-b638-000cb3b1763f req-200ca9b5-4e46-410f-922f-6886a906a349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420d5478-b9a8-440a-a872-e1f3f94f0fb0", "name": "network-vif-deleted", "tag": "7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc"}]} {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 16:33:49.896006 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-669cbf5a-2288-4956-b638-000cb3b1763f req-200ca9b5-4e46-410f-922f-6886a906a349 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:49.896445 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG oslo_concurrency.lockutils [req-669cbf5a-2288-4956-b638-000cb3b1763f req-200ca9b5-4e46-410f-922f-6886a906a349 service nova] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:49.908066 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.compute.server_external_events [req-669cbf5a-2288-4956-b638-000cb3b1763f req-200ca9b5-4e46-410f-922f-6886a906a349 service nova] Creating event network-vif-deleted:7a41718a-ff0c-4fbf-bf6e-fb97b73c8bdc for instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 on hv-cinder-79760 Jul 12 16:33:49.913443 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [req-669cbf5a-2288-4956-b638-000cb3b1763f req-200ca9b5-4e46-410f-922f-6886a906a349 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093067 Jul 12 16:33:49.914037 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 555/1088] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 16:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 16:33:50.642529 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:33:50.643149 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] [instance: 420d5478-b9a8-440a-a872-e1f3f94f0fb0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 16:33:50.650418 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:50.650870 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:50.651659 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 16:33:50.652104 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Lock "02b9952f-784f-4d3b-9d9e-620e0dcce44e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 16:33:50.667420 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] HTTP exception thrown: Instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 could not be found. Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Request method failure captured: Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 HTTP/1.1 Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept: application/json Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Connection: close Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Length: 0 Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Content-Type: application/json Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Host: 10.222.0.20 Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.9 Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABizaFigoT7UFnPFL1IdW1Xh4VK4JnDiMEOLt9x09jrwLmYO5CDuoOIA2jnREpfegOYzYvafnd1SnS2jh2PBAUYZ_awtsjBorz1OqtYTa03-6yefh64J0q6v1wImNhCdgNwwDXCLLUXyIoQy5e6qkpZjqwWq71sbd8hwbd5XL2ZF7tuXi4 Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Id: 50404e382aca4cd0b0e0321a0e5294ea Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestShelveInstance-1419596270 Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Role: reader,member Jul 12 16:33:50.669081 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/50404e382aca4cd0b0e0321a0e5294ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/50404e382aca4cd0b0e0321a0e5294ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/50404e382aca4cd0b0e0321a0e5294ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_50404e382aca4cd0b0e0321a0e5294ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestShelveInstance-1419596270 Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 50404e382aca4cd0b0e0321a0e5294ea Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestShelveInstance-1419596270 Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User: tempest-TestShelveInstance-1419596270-project Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Id: df0360a875a74828874ef2a55f596be1 Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestShelveInstance-1419596270-project Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: method: > Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: exception: Instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 could not be found. Jul 12 16:33:50.670811 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: action_args: {'id': '420d5478-b9a8-440a-a872-e1f3f94f0fb0'} Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 could not be found. Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 16:33:50.671885 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 could not be found. Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 could not be found. Jul 12 16:33:50.673520 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Jul 12 16:33:50.675061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Returning 404 to user: Instance 420d5478-b9a8-440a-a872-e1f3f94f0fb0 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 16:33:50.675061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e9173fe4-7025-489f-b2d0-a4fc82eb97cd tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0" status: 404 len: 111 microversion: 2.1 time: 0.032161 Jul 12 16:33:50.675061 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 534/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 16:33:50 2022] GET /compute/v2.1/servers/420d5478-b9a8-440a-a872-e1f3f94f0fb0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 16:33:50.845077 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: DEBUG nova.api.openstack.wsgi [None req-55f08fbe-eeb4-4f8d-9b16-a0854668eefc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] Calling method '.version_select at 0x7f1da5c16af0>' {{(pid=117791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 16:33:50.870718 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO nova.api.openstack.requestlog [None req-55f08fbe-eeb4-4f8d-9b16-a0854668eefc tempest-TestShelveInstance-1419596270 tempest-TestShelveInstance-1419596270-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-112083651" status: 202 len: 0 microversion: 2.1 time: 0.030493 Jul 12 16:33:50.871296 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: [pid: 117791|app: 0|req: 556/1090] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 16:33:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-112083651 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 16:35:20.728106 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:35:20.728672 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Tue Jul 12 16:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:35:20.922131 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:35:20.922342 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Tue Jul 12 16:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:36:56.728922 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:36:56.729541 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Tue Jul 12 16:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:37:03.214777 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:37:03.215520 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Tue Jul 12 16:37:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:38:40.736921 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:38:40.737532 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Tue Jul 12 16:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:38:40.930136 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:38:40.930343 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Tue Jul 12 16:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:39:01.466226 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:39:01.466725 dv-cinder-797608-56-iscsi devstack@n-api.service[117791]: Tue Jul 12 16:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 16:39:03.846600 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 16:39:03.847155 dv-cinder-797608-56-iscsi devstack@n-api.service[117792]: Tue Jul 12 16:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!